Aug 25 06:43:38 devstack cinder-volume[83395]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:43:38 devstack cinder-volume[83395]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:43:38 devstack cinder-volume[83395]: we strongly recommend against using it for new projects. Aug 25 06:43:38 devstack cinder-volume[83395]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:43:38 devstack cinder-volume[83395]: framework. For more detail see Aug 25 06:43:38 devstack cinder-volume[83395]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:43:38 devstack cinder-volume[83395]: import eventlet # noqa Aug 25 06:43:41 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:43:41 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:43:41 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:43:42 devstack cinder-volume[83395]: INFO dbcounter [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Registered counter for database cinder Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG dbcounter [-] [83395] Writer thread running {{(pid=83395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:43:42 devstack cinder-volume[83395]: INFO cinder.rpc [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:43:42 devstack cinder-volume[83395]: INFO cinder.rpc [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:43:42 devstack cinder-volume[83395]: INFO cinder.volume.manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Determined volume DB was empty at startup. Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG cinder.volume.manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83395) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 25 06:43:42 devstack cinder-volume[83395]: INFO cinder.volume.manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 25 06:43:42 devstack cinder-volume[83395]: WARNING stevedore.named [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:43:42 devstack cinder-volume[83395]: WARNING castellan.key_manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:43:42 devstack cinder-volume[83395]: WARNING cinder.keymgr.conf_key_mgr [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG cinder.volume.drivers.lvm [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83395) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 25 06:43:42 devstack cinder-volume[83395]: DEBUG oslo_concurrency.processutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_concurrency.processutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.502s {{(pid=83395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:43:43 devstack cinder-volume[83395]: INFO cinder.rpc [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 25 06:43:43 devstack cinder-volume[83395]: INFO cinder.rpc [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Aug 25 06:43:43 devstack cinder-volume[83395]: WARNING stevedore.named [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:43:43 devstack cinder-volume[83395]: WARNING castellan.key_manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:43:43 devstack cinder-volume[83395]: INFO cinder.volume.manager [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:43:43 devstack cinder-volume[83395]: INFO oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Starting 1 workers Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Started child 83548 {{(pid=83395) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Full set of CONF: {{(pid=83395) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] ******************************************************************************** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Configuration options gathered from: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] ================================================================================ {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] allow_availability_zone_fallback = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] allow_compression_on_image_upload = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] allowed_direct_url_schemes = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] api_rate_limit = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] auth_strategy = keystone {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83548]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] az_cache_duration = 3600 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_availability_zone = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_host = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_stats_polling_interval = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backup_api_class = cinder.backup.api.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backup_name_template = backup-%s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backup_use_same_host = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backup_use_temp_snapshot = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] chap_password = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] chap_username = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_internal_tenant_project_id = 0bb5997c6bf643128f490d432d93e1ba {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_internal_tenant_user_id = 03d3abdb5bd5497c9f5e63287abbcf0d {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cloned_volume_same_az = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cluster = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] compression_format = gzip {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] compute_api_class = cinder.compute.nova.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] config_dir = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] config_source = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] control_exchange = openstack {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] debug = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] default_availability_zone = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] default_group_type = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] default_volume_type = lvmdriver-1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] disk_geometry = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_client_cert = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_client_cert_key = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_data_namespace = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_ssl_cert_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_ssl_cert_verify = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] driver_use_ssl = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] enable_force_upload = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] enable_new_services = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] enable_unsupported_driver = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] enforce_multipath_for_image_xfer = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] filter_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_api_insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_api_ssl_compression = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_ca_certificates_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_catalog_info = image:glance:publicURL {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_num_retries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance_request_timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] goodness_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] graceful_shutdown_timeout = 5 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] group_api_class = cinder.group.api.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] host = devstack {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_compress_on_upload = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_conversion_address_space_limit = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_conversion_cpu_limit = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_conversion_disable = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_upload_use_cinder_backend = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_upload_use_internal_tenant = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_volume_cache_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_volume_cache_max_count = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] image_volume_cache_max_size_gb = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] init_host_max_objects_retrieval = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] instance_format = [instance: %(uuid)s] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iscsi_target_flags = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iscsi_write_cache = on {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iser_helper = tgtadm {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iser_ip_address = 192.168.122.222 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iser_port = 3260 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_color = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_config_append = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_dir = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_options = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_rotate_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_rotate_interval_type = days {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] log_rotation_type = none {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] max_age = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] max_logfile_count = 30 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] max_logfile_size_mb = 200 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] max_over_subscription_ratio = 20.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] message_reap_interval = 86400 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] message_ttl = 2592000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] migration_create_volume_timeout_secs = 300 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] monkey_patch = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] monkey_patch_modules = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] my_ip = 192.168.122.222 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] no_snapshot_gb_quota = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] num_iser_scan_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] num_shell_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] num_volume_device_scan_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] nvmeof_conn_info_version = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] nvmet_ns_id = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] nvmet_port_id = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_max_limit = 1000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_ext_list = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_listen_port = 8776 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_use_ssl = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] osapi_volume_workers = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] per_volume_size_limit = -1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] periodic_fuzzy_delay = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] periodic_interval = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] public_endpoint = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] publish_errors = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_backup_gigabytes = 1000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_backups = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_gigabytes = 1000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_groups = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_snapshots = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] quota_volumes = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] rate_limit_burst = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] rate_limit_except_level = CRITICAL {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] rate_limit_interval = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] reinit_driver_count = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] replication_device = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] replication_encryption_keys = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] report_discard_supported = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] report_interval = 120 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] reservation_clean_interval = 86400 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] reservation_expire = 86400 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] reserved_image_namespaces = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] reserved_percentage = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] rpc_response_timeout = 120 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] run_external_periodic_tasks = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] scst_target_driver = iscsi {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] scst_target_iqn_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_down_time = 720 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] shell_completion = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] snapshot_name_template = snapshot-%s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] snapshot_same_host = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] split_loggers = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] state_path = /opt/stack/data/cinder {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] storage_availability_zone = nova {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] storage_protocol = iSCSI {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] syslog_log_facility = LOG_USER {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_helper = lioadm {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_ip_address = 192.168.122.222 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_port = 3260 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_protocol = iscsi {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] target_secondary_ip_addresses = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] trace_flags = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] transport_url = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] until_refresh = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_chap_auth = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_default_quota_class = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_journal = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_json = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_multipath_for_image_xfer = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_stderr = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] use_syslog = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] verify_glance_signatures = enabled {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_api_class = cinder.volume.api.API {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_backend_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_clear = zero {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_clear_ionice = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_clear_size = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_copy_bps_limit = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_dd_blocksize = 1M {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_name_template = volume-%s {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_service_inithost_offload = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volume_usage_audit_period = month {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] zoning_mode = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_concurrency.disable_process_locking = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.auth_section = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.auth_type = password {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.auth_version = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.cache = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.include_service_catalog = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.interface = public {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_password = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcache_username = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: INFO cinder.volume.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.region_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.service_type = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.backend = dogpile.cache.null {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.backend_argument = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.backend_expiration_time = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.config_prefix = cache.oslo {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.debug_cache_backend = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.enable_retry_client = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.enable_socket_keepalive = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.expiration_time = 600 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.hashclient_retry_attempts = 2 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_dead_retry = 300 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_pool_maxsize = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_sasl_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.password = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.proxies = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.redis_db = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.redis_server = localhost:6379 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.retry_attempts = 2 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.retry_delay = 0.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.socket_keepalive_count = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.socket_keepalive_idle = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.socket_keepalive_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.socket_timeout = 1.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.tls_allowed_ciphers = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.tls_cafile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.tls_certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.tls_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.tls_keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cache.username = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] coordination.backend_url = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.asyncio_connection = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.asyncio_slave_connection = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.backend = sqlalchemy {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.connection = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.connection_debug = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.connection_parameters = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.connection_recycle_time = 3600 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.connection_trace = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.db_inc_retry_interval = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.db_max_retries = 20 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.db_max_retry_interval = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.db_retry_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.max_overflow = 50 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.max_pool_size = 5 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.max_retries = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.mysql_wsrep_sync_wait = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.pool_timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.retry_interval = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.slave_connection = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.sqlite_synchronous = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.synchronous_reader = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] database.use_db_reconnect = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.connection_string = messaging:// {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.es_doc_type = notification {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.es_scroll_size = 10000 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.es_scroll_time = 2m {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.filter_error_trace = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.hmac_keys = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.sentinel_service_name = mymaster {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.socket_timeout = 0.1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.trace_requests = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler.trace_sqlalchemy = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler_jaeger.process_tags = {} {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler_jaeger.service_name_prefix = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] profiler_otlp.service_name_prefix = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.enforce_new_defaults = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.policy_default_rule = default {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.policy_file = policy.yaml {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.group = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.helper_command = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] privsep_osbrick.user = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.group = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.helper_command = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] cinder_sys_admin.user = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.auth_section = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.auth_type = password {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.cafile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.collect_timing = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.send_service_user_token = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.split_loggers = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] service_user.timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.auth_section = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.auth_type = password {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.collect_timing = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.region_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.split_loggers = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] glance.timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.backend_availability_zone = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.chap_password = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.chap_username = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.disk_geometry = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_client_cert = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_client_cert_key = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_data_namespace = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.driver_use_ssl = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.extra_capabilities = {} {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.filter_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.goodness_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iscsi_target_flags = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iscsi_write_cache = on {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iser_helper = tgtadm {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iser_port = 3260 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.lvm_share_target = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.lvm_type = auto {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.num_shell_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.replication_device = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.replication_encryption_keys = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.report_discard_supported = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.reserved_percentage = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_helper = tgtadm {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_port = 3260 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_protocol = iscsi {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.trace_flags = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.unique_fqdn_network = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.use_chap_auth = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_backend_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_clear = zero {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_clear_ionice = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_clear_size = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_reports.file_event_handler = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_reports.log_dir = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.backend_host = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.chap_password = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.chap_username = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.disk_geometry = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_client_cert = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.extra_capabilities = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.filter_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.goodness_function = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iser_helper = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iser_ip_address = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iser_port = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.lvm_share_target = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.lvm_type = auto {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.num_shell_tries = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.replication_device = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.replication_encryption_keys = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.report_discard_supported = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.reserved_percentage = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.scst_target_driver = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.storage_protocol = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_helper = lioadm {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_ip_address = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_port = 3260 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.trace_flags = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.use_chap_auth = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_clear = zero {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_clear_size = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] lvmdriver-1.volumes_dir = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_notifications.driver = [] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_notifications.retry = -1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] key_manager.fixed_key = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.barbican_api_version = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.barbican_endpoint = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.barbican_endpoint_type = public {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.barbican_region_name = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.cafile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.collect_timing = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.number_of_retries = 60 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.retry_delay = 1 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.send_service_user_token = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.split_loggers = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.verify_ssl = True {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican.verify_ssl_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.auth_section = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.auth_type = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.cafile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.certfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.collect_timing = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.insecure = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.keyfile = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.split_loggers = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] barbican_service_user.timeout = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.approle_role_id = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.approle_secret_id = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.auth_method = approle {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.auth_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.kv_mountpoint = secret {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.kv_path = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.kv_version = 2 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.namespace = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.root_token_id = **** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.ssl_ca_crt_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.timeout = 60.0 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.token_file = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.token_role = None {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.use_ssl = False {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:43:43 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] ******************************************************************************** {{(pid=83395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:43:43 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:43 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:43 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:43 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:44 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.356s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:43:44 devstack cinder-volume[83548]: INFO cinder.brick.local_dev.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:44 devstack sudo[83681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:44 devstack sudo[83681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:44 devstack sudo[83681]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG cinder.brick.local_dev.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83548) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 25 06:43:44 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:44 devstack sudo[83780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:44 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:45 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:45 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:45 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 25 06:43:45 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:45 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.309s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack sudo[84167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:45 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:45 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:45 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:45 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:45 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:46 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:46 devstack sudo[84254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:46 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:46 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:46 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:46 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:46 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:46 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:46 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:46 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:47 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:47 devstack cinder-volume[83548]: INFO cinder.volume.drivers.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:47 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:47 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:47 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:47 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:47 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:47 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:47 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:47 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:47 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:47 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:47 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:47 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:48 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:48 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:48 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:48 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:48 devstack cinder-volume[83548]: INFO cinder.volume.driver [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG cinder.volume.driver [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83548) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_db.sqlalchemy.engines [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83548) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writer thread running {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG cinder.db.api [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Building query based on filter {{(pid=83548) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG cinder.image.image_utils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83548) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:43:48 devstack cinder-volume[83548]: INFO cinder.keymgr.migration [None req-b0d1b9c2-a29c-4e8e-9176-f51715482009 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:48 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:48 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:48 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:48 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:48 devstack sudo[84378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:48 devstack sudo[84378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:49 devstack sudo[84378]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:49 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:49 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:49 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:49 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:49 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:49 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG cinder.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Notifying Schedulers of capabilities ... {{(pid=83548) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:43:49 devstack cinder-volume[83548]: INFO cinder.volume.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Driver initialization completed successfully. Aug 25 06:43:49 devstack cinder-volume[83548]: INFO cinder.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Initiating service 2 cleanup Aug 25 06:43:49 devstack cinder-volume[83548]: INFO cinder.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Service 2 cleanup completed. Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG cinder.service [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Creating RPC server for service cinder-volume {{(pid=83548) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG cinder.service [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83548) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:43:49 devstack cinder-volume[83548]: INFO cinder.volume.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:43:49 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:49 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:43:49 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:50 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:50 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:50 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:50 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:50 devstack sudo[84400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:43:50 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:50 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:43:50 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:43:50 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:43:50 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Aug 25 06:43:50 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:43:50 devstack cinder-volume[83548]: INFO cinder.volume.manager [None req-faa0e3f8-0d6c-452a-be5b-12be247b59a8 None None] Driver post RPC initialization completed successfully. Aug 25 06:43:53 devstack cinder-volume[83395]: DEBUG dbcounter [-] [83395] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:00 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:00 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:20 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager._thread_info {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:44:20 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread count: 6 {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:44:20 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread info: [<_MainThread(MainThread, started 123303459938432)>, , , , , ] {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:45:20 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:45:20 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:45:20 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:20 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:45:20 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:21 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:21 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:45:21 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:21 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:21 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:45:21 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:21 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:21 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:45:21 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:21 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:21 devstack cinder-volume[83548]: DEBUG cinder.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Notifying Schedulers of capabilities ... {{(pid=83548) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:45:22 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager._thread_info {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:45:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread count: 6 {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:45:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread info: [<_MainThread(MainThread, started 123303459938432)>, , , , , ] {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:46:00 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:46:20 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:46:20 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:46:20 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:20 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:46:20 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:21 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:21 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:46:21 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:21 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:21 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:46:21 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:21 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:21 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:46:21 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:22 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:22 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:22 devstack cinder-volume[83548]: DEBUG cinder.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Notifying Schedulers of capabilities ... {{(pid=83548) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:46:22 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager._thread_info {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:46:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread count: 6 {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:46:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread info: [<_MainThread(MainThread, started 123303459938432)>, , , , , ] {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:47:20 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:47:20 devstack cinder-volume[83548]: DEBUG cinder.volume.drivers.lvm [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Updating volume stats {{(pid=83548) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:47:20 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:20 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:47:20 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:21 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:21 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:47:21 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:21 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:21 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:47:21 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:21 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:21 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:21 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:47:21 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:22 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:22 devstack cinder-volume[83548]: DEBUG oslo_concurrency.processutils [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83548) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:22 devstack cinder-volume[83548]: DEBUG cinder.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Notifying Schedulers of capabilities ... {{(pid=83548) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:47:22 devstack cinder-volume[83548]: DEBUG oslo_service.periodic_task [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] Running periodic task VolumeManager._thread_info {{(pid=83548) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:47:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread count: 6 {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:47:22 devstack cinder-volume[83548]: DEBUG cinder.volume.manager [None req-6ec03db3-702c-4389-9356-5a6962d2d0c8 None None] thread info: [<_MainThread(MainThread, started 123303459938432)>, , , , , ] {{(pid=83548) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:48:00 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writing DB stats cinder:SELECT=1 {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:00 devstack cinder-volume[83548]: DEBUG dbcounter [-] [83548] Writing DB stats cinder:UPDATE=1 {{(pid=83548) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:14 devstack cinder-volume[83395]: INFO oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Caught SIGTERM, stopping children Aug 25 06:48:14 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Acquiring lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:14 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Acquired lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:14 devstack cinder-volume[83395]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Releasing lock "singleton_lock" {{(pid=83395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:14 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Stop services. {{(pid=83395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 25 06:48:14 devstack cinder-volume[83395]: DEBUG oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Killing children. {{(pid=83395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 25 06:48:14 devstack cinder-volume[83395]: INFO oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Waiting on 1 children to exit Aug 25 06:48:14 devstack cinder-volume[83548]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Acquiring lock "singleton_lock" {{(pid=83548) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:14 devstack cinder-volume[83548]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Acquired lock "singleton_lock" {{(pid=83548) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:14 devstack cinder-volume[83548]: DEBUG oslo_concurrency.lockutils [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Releasing lock "singleton_lock" {{(pid=83548) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:14 devstack cinder-volume[83548]: WARNING amqp [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:14 devstack cinder-volume[83548]: WARNING amqp [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:14 devstack cinder-volume[83395]: INFO oslo_service.backend._eventlet.service [None req-4d5356a1-c6af-4f29-be07-1e3cee8047f1 None None] Child 83548 exited with status 0 Aug 25 06:48:15 devstack cinder-volume[93691]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:48:15 devstack cinder-volume[93691]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:48:15 devstack cinder-volume[93691]: we strongly recommend against using it for new projects. Aug 25 06:48:15 devstack cinder-volume[93691]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:48:15 devstack cinder-volume[93691]: framework. For more detail see Aug 25 06:48:15 devstack cinder-volume[93691]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:48:15 devstack cinder-volume[93691]: import eventlet # noqa Aug 25 06:48:17 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:17 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:17 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:17 devstack cinder-volume[93691]: INFO dbcounter [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Registered counter for database cinder Aug 25 06:48:17 devstack cinder-volume[93691]: DEBUG oslo_db.sqlalchemy.engines [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG dbcounter [-] [93691] Writer thread running {{(pid=93691) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:18 devstack cinder-volume[93691]: INFO cinder.rpc [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:48:18 devstack cinder-volume[93691]: INFO cinder.rpc [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_db.sqlalchemy.engines [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:18 devstack cinder-volume[93691]: INFO cinder.volume.manager [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Determined volume DB was empty at startup. Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG cinder.volume.manager [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93691) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 25 06:48:18 devstack cinder-volume[93691]: INFO cinder.volume.manager [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 25 06:48:18 devstack cinder-volume[93691]: WARNING stevedore.named [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:48:18 devstack cinder-volume[93691]: WARNING castellan.key_manager [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:18 devstack cinder-volume[93691]: WARNING cinder.keymgr.conf_key_mgr [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:18 devstack cinder-volume[93691]: INFO cinder.volume.manager [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_db.sqlalchemy.engines [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:18 devstack cinder-volume[93691]: INFO oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Starting 1 workers Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Started child 93907 {{(pid=93691) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Full set of CONF: {{(pid=93691) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] ******************************************************************************** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Configuration options gathered from: {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] ================================================================================ {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] allow_availability_zone_fallback = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] allow_compression_on_image_upload = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] allowed_direct_url_schemes = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93907]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] api_rate_limit = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] auth_strategy = keystone {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_availability_zone = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_host = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_stats_polling_interval = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backup_api_class = cinder.backup.api.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backup_name_template = backup-%s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backup_use_same_host = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backup_use_temp_snapshot = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] chap_password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] chap_username = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_internal_tenant_project_id = 0bb5997c6bf643128f490d432d93e1ba {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_internal_tenant_user_id = 03d3abdb5bd5497c9f5e63287abbcf0d {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cluster = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] compression_format = gzip {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] compute_api_class = cinder.compute.nova.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] config_dir = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] config_source = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] control_exchange = openstack {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] debug = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] default_availability_zone = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] default_group_type = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] default_volume_type = QuobyteHD {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] disk_geometry = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_client_cert = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_client_cert_key = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_data_namespace = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_ssl_cert_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_ssl_cert_verify = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] driver_use_ssl = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] enable_new_services = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] enable_unsupported_driver = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] enabled_backends = ['QuobyteHD'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] enforce_multipath_for_image_xfer = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] filter_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_api_insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_api_ssl_compression = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_ca_certificates_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_catalog_info = image:glance:publicURL {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_num_retries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance_request_timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] goodness_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] graceful_shutdown_timeout = 5 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] group_api_class = cinder.group.api.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] host = devstack {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_compress_on_upload = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_conversion_address_space_limit = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_conversion_cpu_limit = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_conversion_disable = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_upload_use_cinder_backend = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_upload_use_internal_tenant = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_volume_cache_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_volume_cache_max_count = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] image_volume_cache_max_size_gb = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] init_host_max_objects_retrieval = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] instance_format = [instance: %(uuid)s] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iscsi_target_flags = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iscsi_write_cache = on {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iser_helper = tgtadm {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iser_ip_address = 192.168.122.222 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iser_port = 3260 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93907]: INFO cinder.volume.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Starting volume driver QuobyteDriver (1.2) Aug 25 06:48:18 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.remotefs [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93907) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_color = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_config_append = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_dir = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_options = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_rotate_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_rotate_interval_type = days {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] log_rotation_type = none {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] max_age = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] max_logfile_count = 30 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] max_logfile_size_mb = 200 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] max_over_subscription_ratio = 20.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] message_reap_interval = 86400 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] message_ttl = 2592000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] migration_create_volume_timeout_secs = 300 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] monkey_patch = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] monkey_patch_modules = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] my_ip = 192.168.122.222 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] no_snapshot_gb_quota = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] num_iser_scan_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] num_shell_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] num_volume_device_scan_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] nvmeof_conn_info_version = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] nvmet_ns_id = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] nvmet_port_id = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_max_limit = 1000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_ext_list = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_listen = 0.0.0.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_listen_port = 8776 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_use_ssl = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] osapi_volume_workers = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] per_volume_size_limit = -1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] periodic_fuzzy_delay = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] periodic_interval = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] project_id_regex = [0-9a-f\-]+ {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] public_endpoint = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] publish_errors = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_backup_gigabytes = 1000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_backups = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_gigabytes = 1000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_groups = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_snapshots = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] quota_volumes = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] rate_limit_burst = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] rate_limit_except_level = CRITICAL {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] rate_limit_interval = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] reinit_driver_count = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] replication_device = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] replication_encryption_keys = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] report_discard_supported = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] report_interval = 120 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] reservation_clean_interval = 86400 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] reservation_expire = 86400 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] reserved_image_namespaces = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] reserved_percentage = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] rpc_response_timeout = 120 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] run_external_periodic_tasks = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] scst_target_driver = iscsi {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] scst_target_iqn_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_down_time = 720 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] shell_completion = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] snapshot_name_template = snapshot-%s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] split_loggers = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] state_path = /opt/stack/data/cinder {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] storage_availability_zone = nova {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] storage_protocol = iSCSI {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] syslog_log_facility = LOG_USER {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_helper = lioadm {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_ip_address = 192.168.122.222 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_port = 3260 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_protocol = iscsi {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] target_secondary_ip_addresses = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] trace_flags = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] transfer_api_class = cinder.transfer.api.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] transport_url = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] until_refresh = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_chap_auth = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_default_quota_class = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_journal = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_json = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_multipath_for_image_xfer = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_stderr = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] use_syslog = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] verify_glance_signatures = enabled {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_api_class = cinder.volume.api.API {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_backend_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_clear = zero {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_clear_ionice = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_clear_size = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_copy_bps_limit = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_dd_blocksize = 1M {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_name_template = volume-%s {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_service_inithost_offload = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volume_usage_audit_period = month {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] zoning_mode = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_concurrency.disable_process_locking = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.auth_section = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.auth_type = password {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.auth_version = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.cache = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.delay_auth_decision = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.http_connect_timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.include_service_catalog = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.interface = public {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_password = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcache_username = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.region_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.service_token_roles_required = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.service_type = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.token_cache_time = 300 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.backend = dogpile.cache.null {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.backend_argument = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.backend_expiration_time = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.config_prefix = cache.oslo {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93907) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 25 06:48:18 devstack cinder-volume[93907]: WARNING cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 25 06:48:18 devstack cinder-volume[93907]: WARNING cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 25 06:48:18 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Running cmd (subprocess): mount.quobyte {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.debug_cache_backend = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.enable_retry_client = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.enable_socket_keepalive = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.expiration_time = 600 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.hashclient_retry_attempts = 2 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_dead_retry = 300 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_pool_maxsize = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_sasl_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.proxies = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.redis_db = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.redis_sentinel_service_name = mymaster {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.redis_server = localhost:6379 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.retry_attempts = 2 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.retry_delay = 0.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.socket_keepalive_count = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.socket_keepalive_idle = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.socket_keepalive_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.socket_timeout = 1.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.tls_allowed_ciphers = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.tls_cafile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.tls_certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.tls_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.tls_keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cache.username = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] coordination.backend_url = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.asyncio_connection = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.asyncio_slave_connection = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.backend = sqlalchemy {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.connection = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.connection_debug = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.connection_parameters = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.connection_recycle_time = 3600 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.connection_trace = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.db_inc_retry_interval = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.db_max_retries = 20 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.db_max_retry_interval = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.db_retry_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.max_overflow = 50 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.max_pool_size = 5 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.max_retries = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.mysql_wsrep_sync_wait = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.pool_timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.retry_interval = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.slave_connection = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.sqlite_synchronous = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.synchronous_reader = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] database.use_db_reconnect = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.connection_string = messaging:// {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.es_doc_type = notification {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.es_scroll_size = 10000 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.es_scroll_time = 2m {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.filter_error_trace = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.hmac_keys = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.sentinel_service_name = mymaster {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.socket_timeout = 0.1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.trace_requests = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler.trace_sqlalchemy = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler_jaeger.process_tags = {} {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler_jaeger.service_name_prefix = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] profiler_otlp.service_name_prefix = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.enforce_new_defaults = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.policy_default_rule = default {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.policy_file = policy.yaml {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_policy.remote_timeout = 60.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.group = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.helper_command = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] privsep_osbrick.user = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.group = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.helper_command = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] cinder_sys_admin.user = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.auth_section = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.auth_type = password {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.cafile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.collect_timing = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.send_service_user_token = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.split_loggers = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] service_user.timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.auth_section = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.auth_type = password {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.collect_timing = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.region_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.split_loggers = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] glance.timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.backend_availability_zone = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.chap_password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.chap_username = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.disk_geometry = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_client_cert = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_client_cert_key = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_data_namespace = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.driver_use_ssl = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.enable_unsupported_driver = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.extra_capabilities = {} {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.filter_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.goodness_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iscsi_target_flags = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iscsi_write_cache = on {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iser_helper = tgtadm {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iser_port = 3260 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_host = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_login = admin {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_mount_options = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_private_key = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_share_path = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_ssh_port = 22 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.num_shell_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.nvmet_port_id = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_client_cfg = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.quobyte_volume_url = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.replication_device = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.replication_encryption_keys = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.report_discard_supported = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.reserved_percentage = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.scst_target_driver = iscsi {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.scst_target_iqn_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.storage_protocol = iSCSI {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_helper = tgtadm {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_port = 3260 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_protocol = iscsi {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.trace_flags = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.unique_fqdn_network = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.use_chap_auth = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_backend_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_clear = zero {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_clear_ionice = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_clear_size = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_reports.file_event_handler = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_reports.log_dir = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.backend_availability_zone = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.backend_host = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.chap_password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.chap_username = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.chiscsi_conf = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.disk_geometry = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_client_cert = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_client_cert_key = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_data_namespace = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.driver_use_ssl = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.extra_capabilities = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.filter_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.goodness_function = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iscsi_target_flags = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iscsi_write_cache = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iser_helper = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iser_ip_address = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iser_port = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.iser_target_prefix = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_host = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_login = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_mount_options = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_password = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_private_key = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_share_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_ssh_port = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.num_shell_tries = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nvmet_ns_id = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.nvmet_port_id = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.replication_device = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.replication_encryption_keys = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.report_discard_supported = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.reserved_percentage = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.scst_target_driver = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.storage_protocol = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack quobyte-client[93908]: Reading configuration file: /etc/quobyte/client.cfg Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_helper = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_ip_address = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_port = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_prefix = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_protocol = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack quobyte-client[93908]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.trace_flags = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.unique_fqdn_network = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.use_chap_auth = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_clear = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_clear_ionice = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_clear_size = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] QuobyteHD.volumes_dir = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 -c /etc/quobyte/client-cinder.cfg Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.ssl_version = {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_notifications.driver = [] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_notifications.retry = -1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] oslo_messaging_notifications.transport_url = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:18 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] key_manager.fixed_key = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.barbican_api_version = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=93907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 ... Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 -c /etc/quobyte/client-cinder.cfg {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.barbican_endpoint = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.barbican_endpoint_type = public {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.barbican_region_name = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.cafile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.collect_timing = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.number_of_retries = 60 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.retry_delay = 1 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.send_service_user_token = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.split_loggers = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.verify_ssl = True {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican.verify_ssl_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.auth_section = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.auth_type = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.cafile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.certfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.collect_timing = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.insecure = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.keyfile = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.split_loggers = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] barbican_service_user.timeout = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.approle_role_id = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.approle_secret_id = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.auth_method = approle {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.auth_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.kv_mountpoint = secret {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.kv_path = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.kv_version = 2 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.namespace = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.root_token_id = **** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.ssl_ca_crt_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.timeout = 60.0 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.token_file = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.token_role = None {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.use_ssl = False {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:19 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] ******************************************************************************** {{(pid=93691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:48:19 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.384s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 succeeded Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=93907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:19 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:19 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:19 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.241s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.volume.driver [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.volume.driver [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93907) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_db.sqlalchemy.engines [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93907) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG dbcounter [-] [93907] Writer thread running {{(pid=93907) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.db.api [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Building query based on filter {{(pid=93907) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.image.image_utils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93907) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.keymgr.migration [None req-e12eb961-4a9f-4abf-bac0-7a97c83727fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=93907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=93907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:19 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:19 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:19 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.219s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:19 devstack cinder-volume[93907]: DEBUG cinder.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Notifying Schedulers of capabilities ... {{(pid=93907) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.volume.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Driver initialization completed successfully. Aug 25 06:48:19 devstack cinder-volume[93907]: INFO cinder.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Initiating service 3 cleanup Aug 25 06:48:20 devstack cinder-volume[93907]: INFO cinder.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Service 3 cleanup completed. Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG cinder.service [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Creating RPC server for service cinder-volume {{(pid=93907) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG cinder.service [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93907) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:48:20 devstack cinder-volume[93907]: INFO cinder.volume.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=93907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=93907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:20 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:20 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:20 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:20 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.285s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:20 devstack cinder-volume[93907]: INFO cinder.volume.manager [None req-ecaf3c74-f40e-4a12-9e3f-b5ff255cb30b None None] Driver post RPC initialization completed successfully. Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=93907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG cinder.volume.drivers.quobyte [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=93907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:24 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:24 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:24 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG oslo_concurrency.processutils [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.237s {{(pid=93907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:24 devstack cinder-volume[93907]: DEBUG cinder.manager [None req-b1ecdca1-a005-4b45-a6d7-c06495836fcc None None] Notifying Schedulers of capabilities ... {{(pid=93907) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:48:25 devstack cinder-volume[93691]: INFO oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Caught SIGTERM, stopping children Aug 25 06:48:25 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Acquiring lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:25 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Acquired lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:25 devstack cinder-volume[93691]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Releasing lock "singleton_lock" {{(pid=93691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:25 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Stop services. {{(pid=93691) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 25 06:48:25 devstack cinder-volume[93691]: DEBUG oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Killing children. {{(pid=93691) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 25 06:48:25 devstack cinder-volume[93691]: INFO oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Waiting on 1 children to exit Aug 25 06:48:28 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Acquiring lock "singleton_lock" {{(pid=93907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:28 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Acquired lock "singleton_lock" {{(pid=93907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:28 devstack cinder-volume[93907]: DEBUG oslo_concurrency.lockutils [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Releasing lock "singleton_lock" {{(pid=93907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:28 devstack cinder-volume[93907]: WARNING amqp [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:28 devstack cinder-volume[93907]: WARNING amqp [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:28 devstack cinder-volume[93691]: INFO oslo_service.backend._eventlet.service [None req-29d5833b-809e-4c9d-ab74-3f0c6594517b None None] Child 93907 exited with status 0 Aug 25 06:48:28 devstack cinder-volume[94189]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:48:28 devstack cinder-volume[94189]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:48:28 devstack cinder-volume[94189]: we strongly recommend against using it for new projects. Aug 25 06:48:28 devstack cinder-volume[94189]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:48:28 devstack cinder-volume[94189]: framework. For more detail see Aug 25 06:48:28 devstack cinder-volume[94189]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:48:28 devstack cinder-volume[94189]: import eventlet # noqa Aug 25 06:48:31 devstack cinder-volume[94189]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:31 devstack cinder-volume[94189]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:31 devstack cinder-volume[94189]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:32 devstack cinder-volume[94189]: INFO dbcounter [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Registered counter for database cinder Aug 25 06:48:32 devstack cinder-volume[94189]: DEBUG oslo_db.sqlalchemy.engines [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG dbcounter [-] [94189] Writer thread running {{(pid=94189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:33 devstack cinder-volume[94189]: INFO cinder.rpc [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:48:33 devstack cinder-volume[94189]: INFO cinder.rpc [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_db.sqlalchemy.engines [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:33 devstack cinder-volume[94189]: INFO cinder.volume.manager [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Determined volume DB was empty at startup. Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG cinder.volume.manager [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94189) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 25 06:48:33 devstack cinder-volume[94189]: WARNING stevedore.named [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:48:33 devstack cinder-volume[94189]: WARNING castellan.key_manager [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:33 devstack cinder-volume[94189]: WARNING cinder.keymgr.conf_key_mgr [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:33 devstack cinder-volume[94189]: INFO cinder.volume.manager [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_db.sqlalchemy.engines [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:33 devstack cinder-volume[94189]: INFO oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Starting 1 workers Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Started child 94487 {{(pid=94189) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Full set of CONF: {{(pid=94189) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] ******************************************************************************** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] Configuration options gathered from: {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] ================================================================================ {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] allow_availability_zone_fallback = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] allow_compression_on_image_upload = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] allowed_direct_url_schemes = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] api_rate_limit = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] auth_strategy = keystone {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_availability_zone = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_host = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_stats_polling_interval = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backup_api_class = cinder.backup.api.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backup_name_template = backup-%s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backup_use_same_host = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backup_use_temp_snapshot = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] chap_password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] chap_username = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_internal_tenant_project_id = 0bb5997c6bf643128f490d432d93e1ba {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_internal_tenant_user_id = 03d3abdb5bd5497c9f5e63287abbcf0d {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cluster = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] compression_format = gzip {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] compute_api_class = cinder.compute.nova.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] config_dir = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] config_source = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] control_exchange = openstack {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] debug = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] default_availability_zone = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] default_group_type = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] default_volume_type = QuobyteHD {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] disk_geometry = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_client_cert = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_client_cert_key = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_data_namespace = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_ssl_cert_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_ssl_cert_verify = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] driver_use_ssl = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] enable_new_services = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] enable_unsupported_driver = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] enabled_backends = ['QuobyteHD'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] enforce_multipath_for_image_xfer = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] filter_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_api_insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_api_ssl_compression = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_ca_certificates_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_catalog_info = image:glance:publicURL {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_num_retries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance_request_timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] goodness_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] graceful_shutdown_timeout = 5 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] group_api_class = cinder.group.api.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] host = devstack {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_compress_on_upload = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_conversion_address_space_limit = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_conversion_cpu_limit = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_conversion_disable = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_upload_use_cinder_backend = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_upload_use_internal_tenant = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_volume_cache_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_volume_cache_max_count = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] image_volume_cache_max_size_gb = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] init_host_max_objects_retrieval = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] instance_format = [instance: %(uuid)s] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iscsi_target_flags = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iscsi_write_cache = on {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iser_helper = tgtadm {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iser_ip_address = 192.168.122.222 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iser_port = 3260 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_color = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Starting volume driver QuobyteDriver (1.2) Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94487) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_config_append = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_dir = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_options = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_rotate_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_rotate_interval_type = days {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] log_rotation_type = none {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] max_age = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] max_logfile_count = 30 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] max_logfile_size_mb = 200 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] max_over_subscription_ratio = 20.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] message_reap_interval = 86400 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] message_ttl = 2592000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] migration_create_volume_timeout_secs = 300 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] monkey_patch = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] monkey_patch_modules = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] my_ip = 192.168.122.222 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] no_snapshot_gb_quota = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] num_iser_scan_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] num_shell_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] num_volume_device_scan_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] nvmeof_conn_info_version = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] nvmet_ns_id = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] nvmet_port_id = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_max_limit = 1000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_ext_list = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_listen_port = 8776 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_use_ssl = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] osapi_volume_workers = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] per_volume_size_limit = -1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] periodic_fuzzy_delay = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] periodic_interval = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] public_endpoint = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] publish_errors = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_backup_gigabytes = 1000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_backups = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_gigabytes = 1000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_groups = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_snapshots = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] quota_volumes = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] rate_limit_burst = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] rate_limit_except_level = CRITICAL {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] rate_limit_interval = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] reinit_driver_count = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] replication_device = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] replication_encryption_keys = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] report_discard_supported = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] report_interval = 120 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] reservation_clean_interval = 86400 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] reservation_expire = 86400 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] reserved_image_namespaces = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] reserved_percentage = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] rpc_response_timeout = 120 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] run_external_periodic_tasks = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] scst_target_driver = iscsi {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] scst_target_iqn_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_down_time = 720 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] shell_completion = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] snapshot_name_template = snapshot-%s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] split_loggers = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] state_path = /opt/stack/data/cinder {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] storage_availability_zone = nova {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] storage_protocol = iSCSI {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] syslog_log_facility = LOG_USER {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_helper = lioadm {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_ip_address = 192.168.122.222 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_port = 3260 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_protocol = iscsi {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] target_secondary_ip_addresses = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] trace_flags = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] transport_url = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] until_refresh = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_chap_auth = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_default_quota_class = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_journal = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_json = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_multipath_for_image_xfer = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_stderr = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] use_syslog = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] verify_glance_signatures = enabled {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_api_class = cinder.volume.api.API {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_backend_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_clear = zero {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_clear_ionice = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_clear_size = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_copy_bps_limit = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_dd_blocksize = 1M {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_name_template = volume-%s {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_service_inithost_offload = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volume_usage_audit_period = month {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] zoning_mode = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_concurrency.disable_process_locking = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.auth_section = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.auth_type = password {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.auth_version = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.cache = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.include_service_catalog = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.interface = public {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_password = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcache_username = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.region_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.service_type = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.backend = dogpile.cache.null {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.backend_argument = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.backend_expiration_time = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.config_prefix = cache.oslo {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.debug_cache_backend = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.enable_retry_client = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.enable_socket_keepalive = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.expiration_time = 600 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.hashclient_retry_attempts = 2 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_dead_retry = 300 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_pool_maxsize = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_sasl_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.proxies = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.redis_db = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.redis_server = localhost:6379 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.retry_attempts = 2 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.retry_delay = 0.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.socket_keepalive_count = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.socket_keepalive_idle = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.socket_keepalive_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.socket_timeout = 1.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.tls_allowed_ciphers = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.tls_cafile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.tls_certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.tls_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.tls_keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cache.username = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] coordination.backend_url = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.asyncio_connection = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.asyncio_slave_connection = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.backend = sqlalchemy {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94487) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 25 06:48:33 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 25 06:48:33 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.connection = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.connection_debug = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.connection_parameters = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Running cmd (subprocess): mount.quobyte {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.connection_recycle_time = 3600 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.connection_trace = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.db_inc_retry_interval = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.db_max_retries = 20 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.db_max_retry_interval = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.db_retry_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.max_overflow = 50 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.max_pool_size = 5 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.max_retries = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.mysql_wsrep_sync_wait = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.pool_timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.retry_interval = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.slave_connection = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.sqlite_synchronous = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.synchronous_reader = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] database.use_db_reconnect = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.connection_string = messaging:// {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.es_doc_type = notification {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.es_scroll_size = 10000 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.es_scroll_time = 2m {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.filter_error_trace = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.hmac_keys = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.sentinel_service_name = mymaster {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.socket_timeout = 0.1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.trace_requests = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler.trace_sqlalchemy = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler_jaeger.process_tags = {} {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler_jaeger.service_name_prefix = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] profiler_otlp.service_name_prefix = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.enforce_new_defaults = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.policy_default_rule = default {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.policy_file = policy.yaml {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.group = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.helper_command = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] privsep_osbrick.user = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.group = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.helper_command = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] cinder_sys_admin.user = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.auth_section = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.auth_type = password {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.cafile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.collect_timing = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.send_service_user_token = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.split_loggers = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] service_user.timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.auth_section = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.auth_type = password {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.collect_timing = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.region_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.split_loggers = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] glance.timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.backend_availability_zone = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.chap_password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.chap_username = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.disk_geometry = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_client_cert = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_client_cert_key = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_data_namespace = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.driver_use_ssl = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.extra_capabilities = {} {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.filter_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.goodness_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iscsi_target_flags = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iscsi_write_cache = on {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iser_helper = tgtadm {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iser_port = 3260 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_host = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack quobyte-client[94488]: Reading configuration file: /etc/quobyte/client.cfg Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_login = admin {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_mount_options = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_private_key = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack quobyte-client[94488]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_share_path = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.num_shell_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.quobyte_volume_url = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.replication_device = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.replication_encryption_keys = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.report_discard_supported = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.reserved_percentage = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_helper = tgtadm {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_port = 3260 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_protocol = iscsi {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.trace_flags = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.unique_fqdn_network = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.use_chap_auth = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_backend_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_clear = zero {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_clear_ionice = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_clear_size = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_reports.file_event_handler = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_reports.log_dir = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.backend_availability_zone = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.backend_host = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.chap_password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.chap_username = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.chiscsi_conf = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.disk_geometry = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_client_cert = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_data_namespace = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.driver_use_ssl = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.extra_capabilities = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.filter_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.goodness_function = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iser_helper = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iser_ip_address = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iser_port = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.iser_target_prefix = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_host = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_login = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_mount_options = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_password = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_private_key = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_share_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_ssh_port = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.num_shell_tries = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.nvmet_port_id = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.replication_device = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.replication_encryption_keys = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.report_discard_supported = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.reserved_percentage = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.scst_target_driver = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.storage_protocol = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_helper = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_ip_address = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_port = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_prefix = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_protocol = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.trace_flags = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.use_chap_auth = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_clear = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_clear_size = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] QuobyteHD.volumes_dir = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_notifications.driver = [] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_notifications.retry = -1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] key_manager.fixed_key = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.barbican_api_version = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.barbican_endpoint = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.barbican_endpoint_type = public {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.barbican_region_name = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.cafile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.collect_timing = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.number_of_retries = 60 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.retry_delay = 1 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.send_service_user_token = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.split_loggers = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.verify_ssl = True {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican.verify_ssl_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.auth_section = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.auth_type = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.cafile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.certfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.collect_timing = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.insecure = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.keyfile = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.split_loggers = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] barbican_service_user.timeout = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.approle_role_id = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.approle_secret_id = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.auth_method = approle {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.auth_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.kv_mountpoint = secret {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.kv_path = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.kv_version = 2 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.namespace = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.root_token_id = **** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.ssl_ca_crt_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.timeout = 60.0 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.token_file = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.token_role = None {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.use_ssl = False {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:33 devstack cinder-volume[94189]: DEBUG oslo_service.backend._eventlet.service [None req-fb23074a-edf2-4d89-8ad4-e1814e5c56c9 None None] ******************************************************************************** {{(pid=94189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:48:33 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.265s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:33 devstack cinder-volume[94487]: INFO cinder.volume.driver [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:48:33 devstack cinder-volume[94487]: DEBUG cinder.volume.driver [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_db.sqlalchemy.engines [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writer thread running {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.db.api [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Building query based on filter {{(pid=94487) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.keymgr.migration [None req-8a37c7c7-6c91-429b-9ee2-2bb1acd54fcf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:48:34 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:34 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:34 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.237s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Driver initialization completed successfully. Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Initiating service 3 cleanup Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Service 3 cleanup completed. Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.service [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Creating RPC server for service cinder-volume {{(pid=94487) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.service [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94487) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:34 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:48:34 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:34 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.247s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ce2b603f-5632-466a-8370-f6d6fc950313 None None] Driver post RPC initialization completed successfully. Aug 25 06:48:43 devstack cinder-volume[94189]: DEBUG dbcounter [-] [94189] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:49:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 6 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:49:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Flow 'volume_create_manager' (0de7ee03-9061-4224-8ab5-3188d63259ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e087fec6-9cb8-4c55-8767-8ef769f711f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e087fec6-9cb8-4c55-8767-8ef769f711f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-733709791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc62d909-4a9e-4e2f-b732-e33a8c4544a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbf397003464295a8fb1053b835129b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:34Z,use_quota=True,user_id='54434f69848043698d9e5760eee84936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b0f94-7811-4e9b-bdeb-aab35fccc45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b0f94-7811-4e9b-bdeb-aab35fccc45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b9ca70-566d-427e-9485-bd378258e851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b9ca70-566d-427e-9485-bd378258e851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc62d909-4a9e-4e2f-b732-e33a8c4544a9', 'volume_name': 'volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7dc736-5700-4217-a08e-6d9f58958cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7dc736-5700-4217-a08e-6d9f58958cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85151312-7e74-4f99-9713-4b7add3fef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Volume fc62d909-4a9e-4e2f-b732-e33a8c4544a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9', 'volume_size': 1} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-733709791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc62d909-4a9e-4e2f-b732-e33a8c4544a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbf397003464295a8fb1053b835129b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:34Z,use_quota=True,user_id='54434f69848043698d9e5760eee84936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Creating volume fc62d909-4a9e-4e2f-b732-e33a8c4544a9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:49:33 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:49:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:33 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 1073741824 Aug 25 06:49:33 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:34 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 1073741824" returned: 0 in 0.665s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:34 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 Aug 25 06:49:34 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:34 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" returned: 0 in 0.313s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85151312-7e74-4f99-9713-4b7add3fef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c048c8e0-dd19-44b5-ad6c-fc5673c32930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:34 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Volume volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 (fc62d909-4a9e-4e2f-b732-e33a8c4544a9): created successfully Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c048c8e0-dd19-44b5-ad6c-fc5673c32930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Flow 'volume_create_manager' (0de7ee03-9061-4224-8ab5-3188d63259ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:49:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d3e61de6-d366-4d3e-af41-f7a36291cc4a tempest-TaggedAttachmentsTest-340463855 None] Created volume successfully. Aug 25 06:49:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:INSERT=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:45 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Flow 'volume_create_manager' (e7ea8bab-75ac-403e-ba65-53530cfc0f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163a8697-c9fb-47a9-931e-266342d416fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163a8697-c9fb-47a9-931e-266342d416fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1361986615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e96c4-e008-4476-b21d-1a86e97c7056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8965ae7d970f4f0891e5948fcfc6ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:47Z,use_quota=True,user_id='c48aa9601c7442f0ba1217f27a19c7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f004bbee-2727-4c63-91b1-8a354dd2dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f004bbee-2727-4c63-91b1-8a354dd2dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efb59d2-4b6f-46d9-994c-427ae917d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efb59d2-4b6f-46d9-994c-427ae917d98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e96c4-e008-4476-b21d-1a86e97c7056', 'volume_name': 'volume-ee4e96c4-e008-4476-b21d-1a86e97c7056', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcad96-2465-4377-88f7-5cdbaade6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcad96-2465-4377-88f7-5cdbaade6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d3d32a-a887-4abf-a1cb-d4dbab652385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Volume ee4e96c4-e008-4476-b21d-1a86e97c7056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e96c4-e008-4476-b21d-1a86e97c7056', 'volume_size': 1} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1361986615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e96c4-e008-4476-b21d-1a86e97c7056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8965ae7d970f4f0891e5948fcfc6ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:47Z,use_quota=True,user_id='c48aa9601c7442f0ba1217f27a19c7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Creating volume ee4e96c4-e008-4476-b21d-1a86e97c7056 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:49:47 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:47 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 1073741824 Aug 25 06:49:47 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:47 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 1073741824" returned: 0 in 0.746s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:48 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 Aug 25 06:49:48 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:48 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d3d32a-a887-4abf-a1cb-d4dbab652385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e96c4-e008-4476-b21d-1a86e97c7056', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b748aa01-60f6-4dbe-8af5-34a14ea90c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Volume volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 (ee4e96c4-e008-4476-b21d-1a86e97c7056): created successfully Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b748aa01-60f6-4dbe-8af5-34a14ea90c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Flow 'volume_create_manager' (e7ea8bab-75ac-403e-ba65-53530cfc0f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:49:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-87edd4aa-b74b-4ef3-a30a-7fe62917cce3 tempest-DeleteServersTestJSON-552569202 None] Created volume successfully. Aug 25 06:49:54 devstack cinder-volume[94487]: WARNING py.warnings [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 25 06:49:54 devstack cinder-volume[94487]: .first() Aug 25 06:49:54 devstack cinder-volume[94487]: Aug 25 06:49:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-ee4e96c4-e008-4476-b21d-1a86e97c7056', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dff428f-33ea-4416-92c2-0e88248fab6d', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:49:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-32ac78af-82cd-4cd2-b3ff-fe7e75824c27 req-10a0c67b-f442-47d9-94d1-a07f9e938791 tempest-DeleteServersTestJSON-552569202 None] attachment_update completed successfully. Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:00 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:50:00 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:01 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.501s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:50:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:50:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 6 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:50:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:50:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-6aa10ffc-2704-4f7e-9af5-f72a653a379c req-0b1254b1-c590-41d0-8291-1845854a2024 tempest-DeleteServersTestJSON-552569202 None] Terminate volume connection completed successfully. Aug 25 06:50:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-6aa10ffc-2704-4f7e-9af5-f72a653a379c req-0b1254b1-c590-41d0-8291-1845854a2024 tempest-DeleteServersTestJSON-552569202 None] Deleting attachment 3dff428f-33ea-4416-92c2-0e88248fab6d. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:50:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "cinder-ee4e96c4-e008-4476-b21d-1a86e97c7056-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "cinder-ee4e96c4-e008-4476-b21d-1a86e97c7056-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "cinder-quobyte-ee4e96c4-e008-4476-b21d-1a86e97c7056" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "cinder-quobyte-ee4e96c4-e008-4476-b21d-1a86e97c7056" acquired by "delete_volume" :: waited 0.057s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:04 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7a3jay93/privsep.sock'] Aug 25 06:50:04 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7a3jay93/privsep.sock Aug 25 06:50:04 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:05 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:50:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Flow 'volume_create_manager' (e8eff4a9-4e4f-4751-b683-a5b96b6757d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8860899e-eb36-4826-84a5-58a71aaf25fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: Aug 25 06:50:06 devstack cinder-volume[94487]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8860899e-eb36-4826-84a5-58a71aaf25fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1390635914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9be317-7cc7-428b-b115-7b410cc1bad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ebf009424e749c299fc95e4b5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:06Z,use_quota=True,user_id='aa9e8b8e19274b1a8812d792f7722d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b126c-8ef7-4f47-9f58-aab82c34d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b126c-8ef7-4f47-9f58-aab82c34d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f0dd0c-0fb8-445d-bf72-714d540906e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f0dd0c-0fb8-445d-bf72-714d540906e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9be317-7cc7-428b-b115-7b410cc1bad6', 'volume_name': 'volume-ac9be317-7cc7-428b-b115-7b410cc1bad6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13e14f4-f6e9-4216-8dda-e2e801b08f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13e14f4-f6e9-4216-8dda-e2e801b08f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ae16db-c034-4902-8c17-4870f4f1541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Volume ac9be317-7cc7-428b-b115-7b410cc1bad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9be317-7cc7-428b-b115-7b410cc1bad6', 'volume_size': 1} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1390635914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9be317-7cc7-428b-b115-7b410cc1bad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ebf009424e749c299fc95e4b5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:06Z,use_quota=True,user_id='aa9e8b8e19274b1a8812d792f7722d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Creating volume ac9be317-7cc7-428b-b115-7b410cc1bad6 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:50:06 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:06 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 1073741824 Aug 25 06:50:06 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:06 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:06 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Spawned new privsep daemon via rootwrap Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Accepted privsep connection to /tmp/tmp7a3jay93/privsep.sock {{(pid=94487) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 25 06:50:06 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 25 06:50:06 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 25 06:50:06 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 25 06:50:06 devstack cinder-volume[94487]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96167 Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb3ab3-b8b4-4855-a91d-f4eaf6047971]: (2,) {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[87caa14e-d843-4404-82aa-ef0917b30e54]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:06 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 Aug 25 06:50:06 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:06 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056" returned: 0 in 0.603s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:07 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056 Aug 25 06:50:07 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:07 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 1073741824" returned: 0 in 0.963s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:07 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 Aug 25 06:50:07 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:07 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ee4e96c4-e008-4476-b21d-1a86e97c7056" returned: 0 in 0.507s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "cinder-quobyte-ee4e96c4-e008-4476-b21d-1a86e97c7056" released by "delete_volume" :: held 3.377s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:07 devstack cinder-volume[94487]: WARNING cinder.quota [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:50:07 devstack cinder-volume[94487]: WARNING cinder.quota [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Created reservations ['6e95b8aa-471d-4897-99cb-7a11312dde3b', 'cf9811b6-b862-438b-8d95-b111612c251d', 'b0fb911e-3cfd-4737-9d21-debd53e9c391', 'f2848a53-f02b-4140-a342-48abf64eca12'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:50:07 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6" returned: 0 in 0.691s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:50:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ae16db-c034-4902-8c17-4870f4f1541e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9be317-7cc7-428b-b115-7b410cc1bad6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24e3471-9131-4059-a9d8-b93a221fa8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:08 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Volume volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 (ac9be317-7cc7-428b-b115-7b410cc1bad6): created successfully Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24e3471-9131-4059-a9d8-b93a221fa8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Flow 'volume_create_manager' (e8eff4a9-4e4f-4751-b683-a5b96b6757d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e5dc7f85-8e80-47b0-99c1-42466e7386bb tempest-VolumesAdminNegativeTest-1999089670 None] Created volume successfully. Aug 25 06:50:08 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:50:08 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:08 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.321s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:50:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Deleted volume successfully. Aug 25 06:50:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-612e74c6-a0dd-4482-993a-1edb5201021e tempest-DeleteServersTestJSON-552569202 None] Lock "cinder-ee4e96c4-e008-4476-b21d-1a86e97c7056-delete_volume" released by "delete_volume" :: held 4.606s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Acquiring lock "cinder-ac9be317-7cc7-428b-b115-7b410cc1bad6-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "cinder-ac9be317-7cc7-428b-b115-7b410cc1bad6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Acquiring lock "cinder-quobyte-ac9be317-7cc7-428b-b115-7b410cc1bad6" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "cinder-quobyte-ac9be317-7cc7-428b-b115-7b410cc1bad6" acquired by "delete_volume" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd4505-625d-4a97-b5f7-3f191c01251b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:10 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 Aug 25 06:50:10 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:10 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6" returned: 0 in 0.584s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:10 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6 Aug 25 06:50:10 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:11 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac9be317-7cc7-428b-b115-7b410cc1bad6" returned: 0 in 0.634s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "cinder-quobyte-ac9be317-7cc7-428b-b115-7b410cc1bad6" released by "delete_volume" :: held 1.291s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Created reservations ['57fab8b7-873f-46c5-a731-7fe9b189c1b4', 'af08eefd-7c15-422b-8415-988cb04b7a57', '37607106-3852-4110-9c68-6fdb69cca442', '1445bcbd-00e7-4179-b28b-d5450e88874d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:11 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:50:11 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:12 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:12 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:50:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Deleted volume successfully. Aug 25 06:50:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c71f008b-e6c2-4762-85be-668da1b5ca03 tempest-VolumesAdminNegativeTest-1999089670 None] Lock "cinder-ac9be317-7cc7-428b-b115-7b410cc1bad6-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:21 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=23,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:22 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ae528249-3a2b-44b2-9ef0-0ddb5e138936 req-8be50088-3bbe-466c-b6dc-f872acce6bd3 tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ae528249-3a2b-44b2-9ef0-0ddb5e138936 req-8be50088-3bbe-466c-b6dc-f872acce6bd3 tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ae528249-3a2b-44b2-9ef0-0ddb5e138936 req-8be50088-3bbe-466c-b6dc-f872acce6bd3 tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ae528249-3a2b-44b2-9ef0-0ddb5e138936 req-8be50088-3bbe-466c-b6dc-f872acce6bd3 tempest-TaggedAttachmentsTest-340463855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66d5a43a-01ac-4633-9aff-d7245395a697', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:50:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ae528249-3a2b-44b2-9ef0-0ddb5e138936 req-8be50088-3bbe-466c-b6dc-f872acce6bd3 tempest-TaggedAttachmentsTest-340463855 None] attachment_update completed successfully. Aug 25 06:50:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-b41de64b-b2d3-45bb-afb7-14daa1d2003e req-56edb0e6-f9a4-4c7e-9284-54d91e63463a tempest-TaggedAttachmentsTest-340463855 None] Terminate volume connection completed successfully. Aug 25 06:50:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-b41de64b-b2d3-45bb-afb7-14daa1d2003e req-56edb0e6-f9a4-4c7e-9284-54d91e63463a tempest-TaggedAttachmentsTest-340463855 None] Deleting attachment 66d5a43a-01ac-4633-9aff-d7245395a697. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:00 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:51:00 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:01 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.594s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:51:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 8 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:51:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:51:05 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:05 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "cinder-fc62d909-4a9e-4e2f-b732-e33a8c4544a9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "cinder-fc62d909-4a9e-4e2f-b732-e33a8c4544a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "cinder-quobyte-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "cinder-quobyte-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8bff8-a853-4144-9d8c-03f84ba99bde]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:51:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:09 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 Aug 25 06:51:09 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:10 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" returned: 0 in 0.526s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:10 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9 Aug 25 06:51:10 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:10 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" returned: 0 in 0.300s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "cinder-quobyte-fc62d909-4a9e-4e2f-b732-e33a8c4544a9" released by "delete_volume" :: held 0.880s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Created reservations ['d5ae9f00-6558-453b-b0fb-e56553213b52', '56381bf2-ee55-48cd-9069-18611830423f', 'ba9a11d2-72f3-4461-abdb-f9bde3204b9f', 'e0e52a87-85e4-4fdc-b7d8-ce00b36df804'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:10 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:51:10 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:10 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.294s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Deleted volume successfully. Aug 25 06:51:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c294808c-9ecf-4fd3-a079-db7a9dc27696 tempest-TaggedAttachmentsTest-340463855 None] Lock "cinder-fc62d909-4a9e-4e2f-b732-e33a8c4544a9-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Flow 'volume_create_manager' (ee59693d-29ab-404a-a959-942f0458bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b788618-7830-45df-8766-8872654568df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b788618-7830-45df-8766-8872654568df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-634923212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6baae6-8b46-4fcc-b561-e7e08affcc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7b8e615724a38b6df6e56e79c7b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:13Z,use_quota=True,user_id='7766c52220c74b508040d71e1cddd66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb981b25-0a87-4d31-b86c-9d1bd2e8701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb981b25-0a87-4d31-b86c-9d1bd2e8701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cc2920-f89c-4a93-ade7-ee9927ccd662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cc2920-f89c-4a93-ade7-ee9927ccd662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6baae6-8b46-4fcc-b561-e7e08affcc5a', 'volume_name': 'volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caab408-ca0e-42c8-8d85-92b7b0bb2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caab408-ca0e-42c8-8d85-92b7b0bb2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d03842-c6b1-47e2-8f0f-026f06600770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Volume 2f6baae6-8b46-4fcc-b561-e7e08affcc5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a', 'volume_size': 1} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-634923212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6baae6-8b46-4fcc-b561-e7e08affcc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7b8e615724a38b6df6e56e79c7b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:13Z,use_quota=True,user_id='7766c52220c74b508040d71e1cddd66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Creating volume 2f6baae6-8b46-4fcc-b561-e7e08affcc5a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:51:13 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:13 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a 1073741824 Aug 25 06:51:13 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:13 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a 1073741824" returned: 0 in 0.500s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:13 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a Aug 25 06:51:13 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:14 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d03842-c6b1-47e2-8f0f-026f06600770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c2852d-dca6-4caf-9625-2075b131fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Volume volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a (2f6baae6-8b46-4fcc-b561-e7e08affcc5a): created successfully Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c2852d-dca6-4caf-9625-2075b131fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Flow 'volume_create_manager' (ee59693d-29ab-404a-a959-942f0458bc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5f6ab8b8-f529-496d-8b1c-9ae687194bed tempest-AttachVolumeShelveTestJSON-1066761004 None] Created volume successfully. Aug 25 06:51:24 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:24 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Flow 'volume_create_manager' (fa8f9263-b8d5-40a3-982f-9a01ea1272e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d61e81-907b-4f1d-92da-51759bac7e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d61e81-907b-4f1d-92da-51759bac7e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-560707564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933b03ca-98d2-44e0-9e8f-595b095bf33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1641df38c747b9a818ddb35f0688de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:26Z,use_quota=True,user_id='0fd3333a4d6e463aa23fe21f79840fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be4e941-d7d7-4d77-96a8-67b7b177bc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be4e941-d7d7-4d77-96a8-67b7b177bc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb61c19-fcb6-45b3-a509-f94426b1e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb61c19-fcb6-45b3-a509-f94426b1e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933b03ca-98d2-44e0-9e8f-595b095bf33f', 'volume_name': 'volume-933b03ca-98d2-44e0-9e8f-595b095bf33f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdb691f-5e43-4832-ae70-e90371edb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdb691f-5e43-4832-ae70-e90371edb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6b0bf1-2927-4ed9-b566-c666ca7256a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Volume 933b03ca-98d2-44e0-9e8f-595b095bf33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933b03ca-98d2-44e0-9e8f-595b095bf33f', 'volume_size': 1} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-560707564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933b03ca-98d2-44e0-9e8f-595b095bf33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1641df38c747b9a818ddb35f0688de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:26Z,use_quota=True,user_id='0fd3333a4d6e463aa23fe21f79840fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Creating volume 933b03ca-98d2-44e0-9e8f-595b095bf33f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:51:25 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:51:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:25 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f 1073741824 Aug 25 06:51:25 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:26 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f 1073741824" returned: 0 in 0.740s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:26 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f Aug 25 06:51:26 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:27 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f" returned: 0 in 0.310s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6b0bf1-2927-4ed9-b566-c666ca7256a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933b03ca-98d2-44e0-9e8f-595b095bf33f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aec60ab-6d98-4dc5-9016-dc119422ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Volume volume-933b03ca-98d2-44e0-9e8f-595b095bf33f (933b03ca-98d2-44e0-9e8f-595b095bf33f): created successfully Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aec60ab-6d98-4dc5-9016-dc119422ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Flow 'volume_create_manager' (fa8f9263-b8d5-40a3-982f-9a01ea1272e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e29fe0d5-7284-49c8-a614-83657cf60056 tempest-ServerActionsTestOtherA-421397448 None] Created volume successfully. Aug 25 06:51:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-83310c10-ddba-4166-ad1b-a90838762875 req-be513131-6d6e-4c14-8004-789d86e510ab tempest-AttachVolumeShelveTestJSON-1066761004 None] No connector for attachment 9be56c03-e886-432f-95b6-b954b711a159; skipping storage backend terminate_connection call. {{(pid=94487) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5031}} Aug 25 06:51:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-83310c10-ddba-4166-ad1b-a90838762875 req-be513131-6d6e-4c14-8004-789d86e510ab tempest-AttachVolumeShelveTestJSON-1066761004 None] Deleting attachment 9be56c03-e886-432f-95b6-b954b711a159. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:51:43 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:43 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Flow 'volume_create_manager' (c22e43d7-2fba-4377-88ee-abe81d7cca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca7cc4-960a-4e93-b19f-219b6c4a3238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca7cc4-960a-4e93-b19f-219b6c4a3238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2070994490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667584a-2844-4e1a-95bc-86ee88bd76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f45ddef7104ed5b96d6f59610e2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:45Z,use_quota=True,user_id='e9ec0f4789374260a18a5a2ba8144206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3098ed-cee6-4416-bfae-6e39b3835e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3098ed-cee6-4416-bfae-6e39b3835e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05edc1f5-37fd-44f1-8934-9e722e71f476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05edc1f5-37fd-44f1-8934-9e722e71f476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9667584a-2844-4e1a-95bc-86ee88bd76f8', 'volume_name': 'volume-9667584a-2844-4e1a-95bc-86ee88bd76f8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfff43af-7f09-4246-88ac-0b17be830878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfff43af-7f09-4246-88ac-0b17be830878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91c4d53-4260-47f7-8708-d93120d8310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Volume 9667584a-2844-4e1a-95bc-86ee88bd76f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9667584a-2844-4e1a-95bc-86ee88bd76f8', 'volume_size': 1} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2070994490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667584a-2844-4e1a-95bc-86ee88bd76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f45ddef7104ed5b96d6f59610e2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:45Z,use_quota=True,user_id='e9ec0f4789374260a18a5a2ba8144206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Creating volume 9667584a-2844-4e1a-95bc-86ee88bd76f8 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:51:45 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:51:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:45 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 1073741824 Aug 25 06:51:45 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:46 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 1073741824" returned: 0 in 0.880s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:46 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 Aug 25 06:51:46 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:46 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8" returned: 0 in 0.504s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:51:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91c4d53-4260-47f7-8708-d93120d8310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9667584a-2844-4e1a-95bc-86ee88bd76f8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbd9d72-1358-42f1-a808-24d71b359fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Volume volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 (9667584a-2844-4e1a-95bc-86ee88bd76f8): created successfully Aug 25 06:51:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbd9d72-1358-42f1-a808-24d71b359fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Flow 'volume_create_manager' (c22e43d7-2fba-4377-88ee-abe81d7cca3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:47 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8f39f85e-028b-4bf9-afe9-3a24f4d0d7df tempest-ServersNegativeTestJSON-63225703 None] Created volume successfully. Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Flow 'volume_create_manager' (6f0fc88e-bae2-40f4-8de5-8143fdc5167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1330f1-9faf-4df2-9d08-4b155d10c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1330f1-9faf-4df2-9d08-4b155d10c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655085291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8ca74b-3a9e-4255-904b-189caed2c5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f45ddef7104ed5b96d6f59610e2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:52Z,use_quota=True,user_id='e9ec0f4789374260a18a5a2ba8144206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2cd441-c093-47ab-8b9a-596a504b1868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2cd441-c093-47ab-8b9a-596a504b1868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962798ca-441a-42f4-b23a-e07012f13d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962798ca-441a-42f4-b23a-e07012f13d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8ca74b-3a9e-4255-904b-189caed2c5f4', 'volume_name': 'volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc98bb5-2791-4fa5-a645-3a89825ee31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc98bb5-2791-4fa5-a645-3a89825ee31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec80015-f781-4a6e-8287-34ee78dfe5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Volume 9f8ca74b-3a9e-4255-904b-189caed2c5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4', 'volume_size': 1} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655085291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8ca74b-3a9e-4255-904b-189caed2c5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f45ddef7104ed5b96d6f59610e2787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:51:52Z,use_quota=True,user_id='e9ec0f4789374260a18a5a2ba8144206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Creating volume 9f8ca74b-3a9e-4255-904b-189caed2c5f4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:51:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:51:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:52 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 1073741824 Aug 25 06:51:52 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:53 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 1073741824" returned: 0 in 0.884s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:53 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 Aug 25 06:51:53 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:53 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4" returned: 0 in 0.357s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec80015-f781-4a6e-8287-34ee78dfe5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadf3ceb-9f15-4312-a8f1-5c36c89453d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Volume volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 (9f8ca74b-3a9e-4255-904b-189caed2c5f4): created successfully Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadf3ceb-9f15-4312-a8f1-5c36c89453d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Flow 'volume_create_manager' (6f0fc88e-bae2-40f4-8de5-8143fdc5167b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c12ba7df-7eb5-4191-8c61-d0873ec02d05 tempest-ServersNegativeTestJSON-63225703 None] Created volume successfully. Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "cinder-9f8ca74b-3a9e-4255-904b-189caed2c5f4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-9f8ca74b-3a9e-4255-904b-189caed2c5f4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "cinder-quobyte-9f8ca74b-3a9e-4255-904b-189caed2c5f4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-quobyte-9f8ca74b-3a9e-4255-904b-189caed2c5f4" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dbf620-c592-4375-a1a6-04b0783032a7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:51:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:56 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 Aug 25 06:51:56 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:56 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4" returned: 0 in 0.663s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:56 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4 Aug 25 06:51:56 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:56 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f8ca74b-3a9e-4255-904b-189caed2c5f4" returned: 0 in 0.359s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-quobyte-9f8ca74b-3a9e-4255-904b-189caed2c5f4" released by "delete_volume" :: held 1.121s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Created reservations ['bfcbe5cb-9730-498d-a118-318e1f6f2fdd', '3b6d3e46-26bc-428e-9397-0bf71c17bb46', '0604874d-062d-4ed9-bd94-ea5b83729dc0', '4f4b02ab-38b9-48d2-b46d-0c9ac7b2a932'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:57 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:51:57 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:57 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:57 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Deleted volume successfully. Aug 25 06:51:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-de5a7eee-0cc3-4647-8a35-e75a5735cff4 tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-9f8ca74b-3a9e-4255-904b-189caed2c5f4-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "cinder-9667584a-2844-4e1a-95bc-86ee88bd76f8-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-9667584a-2844-4e1a-95bc-86ee88bd76f8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "cinder-quobyte-9667584a-2844-4e1a-95bc-86ee88bd76f8" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-quobyte-9667584a-2844-4e1a-95bc-86ee88bd76f8" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[80375819-596e-4e5e-b6ae-ab7db4dddd3d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:58 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 Aug 25 06:51:58 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:58 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8" returned: 0 in 0.497s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:58 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8 Aug 25 06:51:58 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:59 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9667584a-2844-4e1a-95bc-86ee88bd76f8" returned: 0 in 0.371s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-quobyte-9667584a-2844-4e1a-95bc-86ee88bd76f8" released by "delete_volume" :: held 0.944s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Created reservations ['944b8e28-60de-4f62-848c-94fbf5bdc03e', '20072d4a-2e3d-410c-9f5b-add9ffdc1d99', '2feafd1f-e042-46c2-8b49-63f66323210b', 'b444c5a4-d3e3-4dae-a725-f6d32529b503'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:59 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:51:59 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:59 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.286s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Deleted volume successfully. Aug 25 06:51:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c03d948-fef9-43ba-b81a-f77315db446a tempest-ServersNegativeTestJSON-63225703 None] Lock "cinder-9667584a-2844-4e1a-95bc-86ee88bd76f8-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:00 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:52:00 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:01 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.361s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:09 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=29,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:52:09 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=11,cinder:INSERT=7,cinder:UPDATE=15,cinder:DELETE=3 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:52:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-148639b8-247d-416a-bd15-826a7a2526d1 req-6eb70d57-3ff5-4521-b951-b3d868504bbe tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-148639b8-247d-416a-bd15-826a7a2526d1 req-6eb70d57-3ff5-4521-b951-b3d868504bbe tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-148639b8-247d-416a-bd15-826a7a2526d1 req-6eb70d57-3ff5-4521-b951-b3d868504bbe tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-148639b8-247d-416a-bd15-826a7a2526d1 req-6eb70d57-3ff5-4521-b951-b3d868504bbe tempest-ServerActionsTestOtherA-421397448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-933b03ca-98d2-44e0-9e8f-595b095bf33f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61ab7178-0a03-4e20-8b81-9e494f7d06ce', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:52:13 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-148639b8-247d-416a-bd15-826a7a2526d1 req-6eb70d57-3ff5-4521-b951-b3d868504bbe tempest-ServerActionsTestOtherA-421397448 None] attachment_update completed successfully. Aug 25 06:52:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9fd0b35e-47d1-411a-9364-392f43886eee req-b54e60f4-e801-43be-8aea-43f38628014a tempest-ServerActionsTestOtherA-421397448 None] Terminate volume connection completed successfully. Aug 25 06:52:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9fd0b35e-47d1-411a-9364-392f43886eee req-b54e60f4-e801-43be-8aea-43f38628014a tempest-ServerActionsTestOtherA-421397448 None] Deleting attachment 61ab7178-0a03-4e20-8b81-9e494f7d06ce. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:52:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9fd0b35e-47d1-411a-9364-392f43886eee req-c6e57113-d97b-4458-8351-4b4ed90189a0 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9fd0b35e-47d1-411a-9364-392f43886eee req-c6e57113-d97b-4458-8351-4b4ed90189a0 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9fd0b35e-47d1-411a-9364-392f43886eee req-c6e57113-d97b-4458-8351-4b4ed90189a0 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9fd0b35e-47d1-411a-9364-392f43886eee req-c6e57113-d97b-4458-8351-4b4ed90189a0 tempest-ServerActionsTestOtherA-421397448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-933b03ca-98d2-44e0-9e8f-595b095bf33f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd09aa6f7-cc31-4f96-98c4-d7aa4b1fe095', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:52:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9fd0b35e-47d1-411a-9364-392f43886eee req-c6e57113-d97b-4458-8351-4b4ed90189a0 tempest-ServerActionsTestOtherA-421397448 None] attachment_update completed successfully. Aug 25 06:52:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d02ea654-1978-4f7e-aa21-1f4013945a02 tempest-BackendsCapabilitiesAdminTestsJSON-362977310 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Aug 25 06:52:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4f5c5709-e2e8-44e3-8489-42deccde7ede tempest-BackendsCapabilitiesAdminTestsJSON-362977310 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Acquiring lock "cinder-2f6baae6-8b46-4fcc-b561-e7e08affcc5a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "cinder-2f6baae6-8b46-4fcc-b561-e7e08affcc5a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Acquiring lock "cinder-quobyte-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "cinder-quobyte-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a4e48-ebc9-440d-8c0e-092c988a3854]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:28 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a Aug 25 06:52:28 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:28 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:28 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a Aug 25 06:52:28 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:28 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" returned: 0 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "cinder-quobyte-2f6baae6-8b46-4fcc-b561-e7e08affcc5a" released by "delete_volume" :: held 0.775s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Created reservations ['207b1118-6787-4dfb-8b44-c4ec82735b11', '73341255-d531-4a1d-9e9b-a350e61d5897', '35b73b5c-e498-4b99-b8ba-159e3d114941', 'c9fa9abb-9128-4637-9a26-2d418724d7e5'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:29 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:52:29 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:29 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Deleted volume successfully. Aug 25 06:52:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-90d7601a-7e89-40a4-913b-e4d476ff6e06 tempest-AttachVolumeShelveTestJSON-1066761004 None] Lock "cinder-2f6baae6-8b46-4fcc-b561-e7e08affcc5a-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (01c868f5-33b8-4834-94d1-a38f97c88279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870cc463-ce4b-49b4-bd0b-95aa3d4a4012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870cc463-ce4b-49b4-bd0b-95aa3d4a4012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1158926724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39554924-7d5f-4387-8e69-359eb1b991c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:32Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69384164-c7cd-4e86-8c72-f03e1090a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69384164-c7cd-4e86-8c72-f03e1090a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe37e942-cb56-46f0-a88f-0ffcef427277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe37e942-cb56-46f0-a88f-0ffcef427277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39554924-7d5f-4387-8e69-359eb1b991c1', 'volume_name': 'volume-39554924-7d5f-4387-8e69-359eb1b991c1', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abc2f2c-66d1-47d2-85c5-d9c36b99947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abc2f2c-66d1-47d2-85c5-d9c36b99947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afcb9b3-41a7-4e44-b399-18af5752c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:31 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Volume 39554924-7d5f-4387-8e69-359eb1b991c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39554924-7d5f-4387-8e69-359eb1b991c1', 'volume_size': 1} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1158926724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39554924-7d5f-4387-8e69-359eb1b991c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:32Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Creating volume 39554924-7d5f-4387-8e69-359eb1b991c1 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:31 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:31 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 1073741824 Aug 25 06:52:31 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:32 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 1073741824" returned: 0 in 0.631s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:32 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 Aug 25 06:52:32 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:32 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afcb9b3-41a7-4e44-b399-18af5752c943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39554924-7d5f-4387-8e69-359eb1b991c1', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1dc77f-1580-43fc-89fd-ebb497d5af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Volume volume-39554924-7d5f-4387-8e69-359eb1b991c1 (39554924-7d5f-4387-8e69-359eb1b991c1): created successfully Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1dc77f-1580-43fc-89fd-ebb497d5af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (01c868f5-33b8-4834-94d1-a38f97c88279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-da2096c8-999e-434c-af2b-a2ec3a190f2b tempest-AttachVolumeTestJSON-271035856 None] Created volume successfully. Aug 25 06:52:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ce5659c5-2615-4b49-b37a-156ae724937d req-9300be04-d636-468f-a6f6-0aa14f4f3ef2 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ce5659c5-2615-4b49-b37a-156ae724937d req-9300be04-d636-468f-a6f6-0aa14f4f3ef2 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ce5659c5-2615-4b49-b37a-156ae724937d req-9300be04-d636-468f-a6f6-0aa14f4f3ef2 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ce5659c5-2615-4b49-b37a-156ae724937d req-9300be04-d636-468f-a6f6-0aa14f4f3ef2 tempest-AttachVolumeTestJSON-271035856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-39554924-7d5f-4387-8e69-359eb1b991c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baf0ed6e-30ce-4f66-ae54-c0260bc38117', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:52:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ce5659c5-2615-4b49-b37a-156ae724937d req-9300be04-d636-468f-a6f6-0aa14f4f3ef2 tempest-AttachVolumeTestJSON-271035856 None] attachment_update completed successfully. Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Flow 'volume_create_manager' (772fe321-7083-4236-b93e-d0aa5de10c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316d158-05d3-4074-bf81-4d28476ec192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316d158-05d3-4074-bf81-4d28476ec192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772566736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aad69ff-5033-4ff8-8ec2-c190be3160d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635413eaf6a4f6986d35e29c23b3895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:35Z,use_quota=True,user_id='4722f6658a38428eba9d49c054f893c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979c15b3-203a-48cc-85e0-6b7e5c1e62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979c15b3-203a-48cc-85e0-6b7e5c1e62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5435ee40-ca04-4e77-8ba4-97ccc641bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5435ee40-ca04-4e77-8ba4-97ccc641bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aad69ff-5033-4ff8-8ec2-c190be3160d7', 'volume_name': 'volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bf2ee7-e81c-4498-aca8-a02abc16c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bf2ee7-e81c-4498-aca8-a02abc16c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c89ab98-cf25-45c5-8efc-d729ae94c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:35 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7', 'volume_size': 1} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772566736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aad69ff-5033-4ff8-8ec2-c190be3160d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635413eaf6a4f6986d35e29c23b3895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:35Z,use_quota=True,user_id='4722f6658a38428eba9d49c054f893c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Creating volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:35 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:35 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 1073741824 Aug 25 06:52:35 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:36 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 1073741824" returned: 0 in 0.891s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:36 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 Aug 25 06:52:36 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:36 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c89ab98-cf25-45c5-8efc-d729ae94c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d66889-b868-4655-a24e-a7f040b80d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:36 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Volume volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 (9aad69ff-5033-4ff8-8ec2-c190be3160d7): created successfully Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d66889-b868-4655-a24e-a7f040b80d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Flow 'volume_create_manager' (772fe321-7083-4236-b93e-d0aa5de10c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-95a99e71-d7eb-45ba-bf47-d45d0cd68727 tempest-SnapshotsActionsTest-1560088068 None] Created volume successfully. Aug 25 06:52:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Creating offline snapshot 57273b3f-9efd-4822-af0e-345acf983f18 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:52:37 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d5c74-68a4-4efd-9502-52446562dd1e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:37 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 Aug 25 06:52:37 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:38 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7" returned: 0 in 0.380s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:38 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 1G Aug 25 06:52:38 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:38 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 1G" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:38 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:38 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:38 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.335s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:38 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 is being set with open permissions: ugo+rw Aug 25 06:52:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:38 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:38 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:39 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:39 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info Aug 25 06:52:39 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:39 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:39 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info is being set with open permissions: ugo+rw Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:39 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info Aug 25 06:52:39 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:39 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.info" returned: 0 in 0.298s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-40f82769-59e4-42c8-9504-02c238254c32 tempest-SnapshotsActionsTest-1560088068 None] Create snapshot completed successfully Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Flow 'volume_create_manager' (2e0d3d46-2a24-4e44-ba95-e7087f93d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f264d78c-20e5-41e3-bbb4-3aca65c56362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f264d78c-20e5-41e3-bbb4-3aca65c56362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1519484974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c931b9c-f7e6-4c4d-b38d-ed1a003c5721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a951de357a2142c59d1f285ebd1d79ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:41Z,use_quota=True,user_id='71ad246ccdb041b8948a4e50b74572e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ddf821-9e3d-4aa4-9c52-bbb47552d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ddf821-9e3d-4aa4-9c52-bbb47552d982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e0caa-3678-4637-8bad-a140cb21250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e0caa-3678-4637-8bad-a140cb21250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c931b9c-f7e6-4c4d-b38d-ed1a003c5721', 'volume_name': 'volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec56a1f-5e12-491f-962c-195ebd772b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec56a1f-5e12-491f-962c-195ebd772b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6489861-93a8-478b-845a-67ab993aec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Volume 4c931b9c-f7e6-4c4d-b38d-ed1a003c5721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721', 'volume_size': 1} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1519484974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c931b9c-f7e6-4c4d-b38d-ed1a003c5721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a951de357a2142c59d1f285ebd1d79ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:41Z,use_quota=True,user_id='71ad246ccdb041b8948a4e50b74572e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Creating volume 4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:41 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:41 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 1073741824 Aug 25 06:52:41 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:42 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 1073741824" returned: 0 in 0.744s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:42 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 Aug 25 06:52:42 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:42 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" returned: 0 in 0.258s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.668s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Creating offline snapshot 7241b87a-a456-41df-a8b6-56bee8cb188d of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6489861-93a8-478b-845a-67ab993aec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f459820-3f69-47f2-ba2f-6aba0ff68c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e3b29-fbf1-43c8-bc92-c0085942c9ae]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Volume volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 (4c931b9c-f7e6-4c4d-b38d-ed1a003c5721): created successfully Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f459820-3f69-47f2-ba2f-6aba0ff68c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Flow 'volume_create_manager' (2e0d3d46-2a24-4e44-ba95-e7087f93d256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-02081bd7-7ea7-4ac1-82a3-a1884f106694 req-189b19aa-2242-45b6-abfd-4010f5e2ae03 tempest-VolumesGetTestJSON-1199152579 None] Created volume successfully. Aug 25 06:52:42 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:42 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:43 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:43 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d 1G Aug 25 06:52:43 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:43 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d 1G" returned: 0 in 0.766s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:43 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d Aug 25 06:52:43 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Acquiring lock "cinder-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "cinder-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Acquiring lock "cinder-quobyte-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "cinder-quobyte-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" acquired by "delete_volume" :: waited 0.045s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b212f-48cd-4c52-8f06-0a1508115cab]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:44 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 Aug 25 06:52:44 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:44 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d" returned: 0 in 0.471s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:44 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d is being set with open permissions: ugo+rw Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:44 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d Aug 25 06:52:44 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:44 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d" returned: 0 in 0.323s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:44 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" returned: 0 in 0.514s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:44 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721 Aug 25 06:52:44 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e96f6ee2-9908-4464-ad80-60be3e56e20e tempest-SnapshotsActionsTest-1560088068 None] Create snapshot completed successfully Aug 25 06:52:45 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "cinder-quobyte-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721" released by "delete_volume" :: held 0.854s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.quota [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Created reservations ['425d27fd-ce8e-4fb1-bf71-530d66aaa37a', 'a9639823-86d2-4dcd-88ee-d6fc55f9d284', '698200ab-5fcb-4873-bacf-8e2eb07f4ce1', '1dbeca84-5b29-4357-8607-372ebe457d89'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:45 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:52:45 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-7241b87a-a456-41df-a8b6-56bee8cb188d-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-7241b87a-a456-41df-a8b6-56bee8cb188d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-7241b87a-a456-41df-a8b6-56bee8cb188d" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-7241b87a-a456-41df-a8b6-56bee8cb188d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Deleting offline snapshot 7241b87a-a456-41df-a8b6-56bee8cb188d of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] snapshot_file for this snap is: volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc34bb00-552f-4bad-940f-3aeff25d60a8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:45 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.444s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.manager [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Deleted volume successfully. Aug 25 06:52:45 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-3ddbbef4-fcbc-41fe-aca9-c3d76a18fecb req-13665676-c9d2-4e2a-a7ca-4a1fe33f9618 tempest-VolumesGetTestJSON-1199152579 None] Lock "cinder-4c931b9c-f7e6-4c4d-b38d-ed1a003c5721-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:45 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d Aug 25 06:52:45 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:46 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d" returned: 0 in 0.552s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d5522-476a-43d1-a9a3-7aabd8214eb3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:46 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:46 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:46 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.453s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:46 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d Aug 25 06:52:46 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:47 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d" returned: 0 in 0.488s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:47 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d Aug 25 06:52:47 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:47 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7241b87a-a456-41df-a8b6-56bee8cb188d" returned: 0 in 0.284s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-7241b87a-a456-41df-a8b6-56bee8cb188d" released by "_delete_snapshot" :: held 1.941s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_snapshot" :: held 1.983s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:47 devstack cinder-volume[94487]: WARNING cinder.quota [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Created reservations ['5bf792ae-0a1f-4369-97bf-05f1b7f7011d', '5044826d-8973-4d78-9892-2a09a5e69a97', 'b067d334-3aae-4907-bec6-daccd2ec0b85', 'e5042640-f2ed-4221-97d1-c378df421fc2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:47 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Delete snapshot completed successfully. Aug 25 06:52:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b0b88030-0c9c-4353-9a01-05af757c9e62 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-7241b87a-a456-41df-a8b6-56bee8cb188d-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9d2bf093-a285-4cb7-aafe-b60eed5f33d6 req-4f2fa996-ac33-4a41-a1cf-00ea41c5b4fb tempest-ServerActionsTestOtherA-421397448 None] Terminate volume connection completed successfully. Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9d2bf093-a285-4cb7-aafe-b60eed5f33d6 req-4f2fa996-ac33-4a41-a1cf-00ea41c5b4fb tempest-ServerActionsTestOtherA-421397448 None] Deleting attachment d09aa6f7-cc31-4f96-98c4-d7aa4b1fe095. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Creating offline snapshot 1965786b-62e3-4551-9eb3-cd4a17114ec3 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c6a90-eef5-43dd-be9e-518aafad5c2b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:49 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:49 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:49 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.404s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:49 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 1G Aug 25 06:52:49 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (888e4277-64b4-4185-b380-8da4a34d61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd6491e-fc1e-48f4-b322-27197262b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd6491e-fc1e-48f4-b322-27197262b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-407098112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f75110-eb54-4a30-a6b6-116c7d607d80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:50Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d5b8fb-dc90-45a7-a514-8832a278db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d5b8fb-dc90-45a7-a514-8832a278db1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe7c192-e433-4416-8798-4ae2cb6e7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe7c192-e433-4416-8798-4ae2cb6e7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f75110-eb54-4a30-a6b6-116c7d607d80', 'volume_name': 'volume-97f75110-eb54-4a30-a6b6-116c7d607d80', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e4fe42-6b60-48ef-80c4-ae3ce6493b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e4fe42-6b60-48ef-80c4-ae3ce6493b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c03253c-9488-49d1-95c7-a112d6aa9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Volume 97f75110-eb54-4a30-a6b6-116c7d607d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f75110-eb54-4a30-a6b6-116c7d607d80', 'volume_size': 1} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:50 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 1G" returned: 0 in 0.825s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:50 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 Aug 25 06:52:50 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:51 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3" returned: 0 in 0.538s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:51 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 is being set with open permissions: ugo+rw Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:51 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 Aug 25 06:52:51 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:51 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3" returned: 0 in 0.287s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-407098112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f75110-eb54-4a30-a6b6-116c7d607d80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:50Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Creating volume 97f75110-eb54-4a30-a6b6-116c7d607d80 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9d67f0ef-3181-418e-9524-c8bc1d017397 tempest-SnapshotsActionsTest-1560088068 None] Create snapshot completed successfully Aug 25 06:52:51 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 1073741824 Aug 25 06:52:51 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:51 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 1073741824" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:52 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 Aug 25 06:52:52 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:52 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c03253c-9488-49d1-95c7-a112d6aa9221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f75110-eb54-4a30-a6b6-116c7d607d80', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6551a189-2330-4e6d-bc88-b67aefb8c9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Volume volume-97f75110-eb54-4a30-a6b6-116c7d607d80 (97f75110-eb54-4a30-a6b6-116c7d607d80): created successfully Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6551a189-2330-4e6d-bc88-b67aefb8c9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (888e4277-64b4-4185-b380-8da4a34d61ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1da34fd9-3b51-478b-9263-808b3b7c55c2 tempest-VolumesTestJSON-545841676 None] Created volume successfully. Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-1965786b-62e3-4551-9eb3-cd4a17114ec3-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-1965786b-62e3-4551-9eb3-cd4a17114ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-1965786b-62e3-4551-9eb3-cd4a17114ec3" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-1965786b-62e3-4551-9eb3-cd4a17114ec3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Deleting offline snapshot 1965786b-62e3-4551-9eb3-cd4a17114ec3 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] snapshot_file for this snap is: volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8cd971-bb9c-48f5-9539-1fb3fae7a347]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:52 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 Aug 25 06:52:52 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:53 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3" returned: 0 in 0.445s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e194c826-b654-4304-bd05-b771e0c46d8c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:53 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:53 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:53 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:53 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 Aug 25 06:52:53 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:53 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:54 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3 Aug 25 06:52:54 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (2052c216-eb71-4eb3-862c-55413d965498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a15ae7-c753-4039-9466-3fa5550fa211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a15ae7-c753-4039-9466-3fa5550fa211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805517533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c8fd6e-cac5-48cb-a65f-d4e84100a06b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:54Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dc493f-9e02-4cda-94bf-767c6ddcc591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dc493f-9e02-4cda-94bf-767c6ddcc591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18aec3b7-303b-4ae7-82fe-3b82baf1a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18aec3b7-303b-4ae7-82fe-3b82baf1a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c8fd6e-cac5-48cb-a65f-d4e84100a06b', 'volume_name': 'volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d4a4db-9abf-4ce8-9785-01bf0da0d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d4a4db-9abf-4ce8-9785-01bf0da0d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a163aa7b-0b80-40e0-9119-cde4694b54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Volume b8c8fd6e-cac5-48cb-a65f-d4e84100a06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b', 'volume_size': 1} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805517533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c8fd6e-cac5-48cb-a65f-d4e84100a06b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:54Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Creating volume b8c8fd6e-cac5-48cb-a65f-d4e84100a06b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:54 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:54 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b 1073741824 Aug 25 06:52:54 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:54 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.1965786b-62e3-4551-9eb3-cd4a17114ec3" returned: 0 in 0.374s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-1965786b-62e3-4551-9eb3-cd4a17114ec3" released by "_delete_snapshot" :: held 1.804s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_snapshot" :: held 1.836s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Created reservations ['486cf383-7625-4641-aa35-90faf9f5e126', '8f7a6123-1e8e-4537-9513-ddfebdcd073d', '099200fb-da94-44d1-b39d-4d4de39d067d', '94d8d970-8195-498d-9db6-dce85332ff9b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Delete snapshot completed successfully. Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4308fee-8973-4d7c-94de-87e9895010bb tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-1965786b-62e3-4551-9eb3-cd4a17114ec3-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:54 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b 1073741824" returned: 0 in 0.692s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:54 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b Aug 25 06:52:54 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:55 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" returned: 0 in 0.391s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.088s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a163aa7b-0b80-40e0-9119-cde4694b54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7721ed-4a0c-465e-81da-4093ce4b9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Creating offline snapshot 7acc13dc-3bb4-4836-994f-654193bf167a of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:52:55 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Volume volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b (b8c8fd6e-cac5-48cb-a65f-d4e84100a06b): created successfully Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7721ed-4a0c-465e-81da-4093ce4b9b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (2052c216-eb71-4eb3-862c-55413d965498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c36268-364f-42f7-b7db-092f6a9efe7e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-76ea3d89-e88c-4654-9f7a-f0dce7cc8960 tempest-VolumesTestJSON-545841676 None] Created volume successfully. Aug 25 06:52:55 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:55 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:55 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.385s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:55 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a 1G Aug 25 06:52:55 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:56 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a 1G" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:56 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a Aug 25 06:52:56 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:56 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a" returned: 0 in 0.450s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a is being set with open permissions: ugo+rw Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:56 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a Aug 25 06:52:56 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Flow 'volume_create_manager' (d12964ff-6905-4f00-a0f0-12cd2203ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854f6d4c-5061-4c32-bb73-3e20c0cf0243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854f6d4c-5061-4c32-bb73-3e20c0cf0243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1527419204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce624aa-611a-430c-8a6d-72003c8184b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1641df38c747b9a818ddb35f0688de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='0fd3333a4d6e463aa23fe21f79840fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c672887-878c-44d3-9377-fe489c83b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c672887-878c-44d3-9377-fe489c83b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294fc758-a308-4b2c-b42b-a3b89a627962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:52:57 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a" returned: 0 in 0.339s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (27b5ee2c-491b-42e9-ba58-3bd2afbcc3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae7e455-a7d8-4537-85cc-bf7d8e37a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae7e455-a7d8-4537-85cc-bf7d8e37a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-113677961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c837723-c2dc-47ca-bdb5-6d66b9f3be6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba2c800-2288-48f5-87a8-8217ab5b71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba2c800-2288-48f5-87a8-8217ab5b71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6976bf45-3425-4af5-b7a2-12b1f2783b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6976bf45-3425-4af5-b7a2-12b1f2783b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c837723-c2dc-47ca-bdb5-6d66b9f3be6f', 'volume_name': 'volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13678169-e8b4-45b5-8be9-2d7479671f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13678169-e8b4-45b5-8be9-2d7479671f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bb8a41-8820-4ec4-a1be-656cc53808cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Volume 7c837723-c2dc-47ca-bdb5-6d66b9f3be6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f', 'volume_size': 1} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-113677961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c837723-c2dc-47ca-bdb5-6d66b9f3be6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85f1a13638ee46c89da7c604f0a55a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='b027710da65b478a9f7f1d7707a0971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Creating volume 7c837723-c2dc-47ca-bdb5-6d66b9f3be6f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:57 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-adb34c3e-ba24-4ec1-9193-760890b1ec43 tempest-SnapshotsActionsTest-1560088068 None] Create snapshot completed successfully Aug 25 06:52:57 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f 1073741824 Aug 25 06:52:57 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294fc758-a308-4b2c-b42b-a3b89a627962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ce624aa-611a-430c-8a6d-72003c8184b2', 'volume_name': 'volume-8ce624aa-611a-430c-8a6d-72003c8184b2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2c828b-9015-41e2-8aad-def70d2db4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2c828b-9015-41e2-8aad-def70d2db4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36e4ad-a4a1-41f4-b9bd-9550187ccf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Volume 8ce624aa-611a-430c-8a6d-72003c8184b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ce624aa-611a-430c-8a6d-72003c8184b2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Trying to clone 8ce624aa-611a-430c-8a6d-72003c8184b2 from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:52:57 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f 1073741824" returned: 0 in 0.602s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-7acc13dc-3bb4-4836-994f-654193bf167a-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:52:57 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-7acc13dc-3bb4-4836-994f-654193bf167a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-7acc13dc-3bb4-4836-994f-654193bf167a" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97df5ad-7471-4e4c-be7c-06c935095124]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:57 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f Aug 25 06:52:57 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-7acc13dc-3bb4-4836-994f-654193bf167a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Deleting offline snapshot 7acc13dc-3bb4-4836-994f-654193bf167a of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:52:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] snapshot_file for this snap is: volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec5b451-2703-4a19-ba83-10e8d32f7dd1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD Aug 25 06:52:58 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a Aug 25 06:52:58 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bb8a41-8820-4ec4-a1be-656cc53808cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8091cd-3dab-4f24-9827-ad2268b146ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:58 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Volume volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f (7c837723-c2dc-47ca-bdb5-6d66b9f3be6f): created successfully Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8091cd-3dab-4f24-9827-ad2268b146ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Flow 'volume_create_manager' (27b5ee2c-491b-42e9-ba58-3bd2afbcc3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7349fcdd-18cc-4ee5-aea6-a6da71bd6b62 tempest-VolumesTestJSON-545841676 None] Created volume successfully. Aug 25 06:52:58 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a is fetched for user 0fd3333a4d6e463aa23fe21f79840fe9. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2ea97-1d83-4a12-acfd-2f5f792e256b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a" returned: 0 in 0.394s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3d5d9-291c-4aee-817d-dfefc24ea3c5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD Aug 25 06:52:58 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:52:58 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1527419204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce624aa-611a-430c-8a6d-72003c8184b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1641df38c747b9a818ddb35f0688de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='0fd3333a4d6e463aa23fe21f79840fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Creating volume 8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:58 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:52:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1073741824 Aug 25 06:52:58 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a Aug 25 06:52:58 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:59 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:59 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1073741824" returned: 0 in 0.473s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:59 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a Aug 25 06:52:59 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:59 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 Aug 25 06:52:59 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:59 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.7acc13dc-3bb4-4836-994f-654193bf167a" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-7acc13dc-3bb4-4836-994f-654193bf167a" released by "_delete_snapshot" :: held 1.592s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:59 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_snapshot" :: held 1.637s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Attempting download of 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 8ce624aa-611a-430c-8a6d-72003c8184b2. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Created reservations ['8d20c96a-bf13-4c67-85fa-406c76f12d77', 'ff7ef62d-1672-4e10-9435-32a21d5e8eed', '809dfa15-94ee-459d-9fa6-589540860c85', 'da4570da-732e-481e-9867-43063eead018'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc5a82-0342-4216-be03-94e206def706]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Delete snapshot completed successfully. Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b52b78d9-c4a1-4874-83b7-471b88cd5a58 tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-7acc13dc-3bb4-4836-994f-654193bf167a-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:59 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt Aug 25 06:52:59 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "cinder-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-quobyte-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e2b74f-7a4e-4812-8563-b73c88c006a5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt" returned: 0 in 0.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f Aug 25 06:53:00 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt Aug 25 06:53:00 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:00 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Creating offline snapshot 5495231c-8a23-4341-a672-ca79f565b9d0 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" returned: 0 in 0.442s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff685b56-cd19-4af1-b208-473a41e0579a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt" returned: 1 in 0.401s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_6ofei1vt' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ee647-d9ae-4b9c-a9b0-d69c67e8ebae]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f Aug 25 06:53:00 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:53:00 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD Aug 25 06:53:00 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f" released by "delete_volume" :: held 0.754s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:00 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Created reservations ['685f03e2-d27d-4da7-9f77-3f4070378801', 'abddafcd-1334-4d7f-85fa-939fdb972e37', '8b2d8a91-8f62-4ef1-87a6-6d77b78a2c86', '20b6f593-145d-4013-8ace-4930bcf81a79'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.407s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 Aug 25 06:53:00 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 1G Aug 25 06:53:00 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:00 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:00 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:01 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "cinder-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.395s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-quobyte-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[134b8b1c-3091-4cf3-8037-7f34d27ac4ce]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:01 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Deleted volume successfully. Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4f8f784a-79b4-4d66-b741-5255a17f0a70 tempest-VolumesTestJSON-545841676 None] Lock "cinder-7c837723-c2dc-47ca-bdb5-6d66b9f3be6f-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:01 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b Aug 25 06:53:01 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:01 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 1G" returned: 0 in 0.706s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:01 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 Aug 25 06:53:01 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:01 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" returned: 0 in 0.448s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:01 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b Aug 25 06:53:01 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:01 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0" returned: 0 in 0.355s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:01 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 is being set with open permissions: ugo+rw Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:01 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 Aug 25 06:53:01 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:01 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" returned: 0 in 0.309s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b" released by "delete_volume" :: held 0.805s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Created reservations ['fabc8188-0c47-4c6b-b901-0389f7066b5e', 'e8b6cb49-73da-4c22-aeb3-dc5608d43cc5', '148a3ba0-6554-4a93-943e-ab98c987bbbb', '4ae97623-17ca-4895-85f1-4be69bb36280'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:02 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0" returned: 0 in 0.283s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:02 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:02 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-62e8075a-7053-4476-bdf1-7a29163b957e tempest-SnapshotsActionsTest-1560088068 None] Create snapshot completed successfully Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-97f75110-eb54-4a30-a6b6-116c7d607d80-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "cinder-97f75110-eb54-4a30-a6b6-116c7d607d80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Acquiring lock "cinder-quobyte-97f75110-eb54-4a30-a6b6-116c7d607d80" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-97f75110-eb54-4a30-a6b6-116c7d607d80" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c523cd4-dd9d-4d87-b4d3-1114147e6af6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:02 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.393s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Deleted volume successfully. Aug 25 06:53:02 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5f92413c-dd5c-454b-9159-2636b5060a9b tempest-VolumesTestJSON-545841676 None] Lock "cinder-b8c8fd6e-cac5-48cb-a65f-d4e84100a06b-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:02 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-5495231c-8a23-4341-a672-ca79f565b9d0-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-5495231c-8a23-4341-a672-ca79f565b9d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Acquiring lock "cinder-quobyte-5495231c-8a23-4341-a672-ca79f565b9d0" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-5495231c-8a23-4341-a672-ca79f565b9d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Deleting offline snapshot 5495231c-8a23-4341-a672-ca79f565b9d0 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] snapshot_file for this snap is: volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c2c21-f2e2-4dbb-a956-869e7bf2491e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:02 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 Aug 25 06:53:02 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:02 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:02 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2" returned: 0 in 2.157s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_jt1p0pbhdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:53:02 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Converted 112.00 MB image at 51.88 MB/s Aug 25 06:53:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:02 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80 Aug 25 06:53:02 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:02 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1G Aug 25 06:53:02 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:03 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a776987-aafd-4144-8f55-0cdf3aacbde8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:03 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-97f75110-eb54-4a30-a6b6-116c7d607d80" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "cinder-quobyte-97f75110-eb54-4a30-a6b6-116c7d607d80" released by "delete_volume" :: held 0.800s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Created reservations ['dc90cdec-de3c-4c43-8cfb-b50ba932e67e', '5e8ae791-0ffe-4db4-bbed-833f410dba86', '677ba5f1-b70d-4145-88d7-b1835f075f88', 'bd7bde60-f368-497d-a23a-a613780b9d66'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:03 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:53:03 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:03 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 1G" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Downloaded image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 8ce624aa-611a-430c-8a6d-72003c8184b2 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a for user 0fd3333a4d6e463aa23fe21f79840fe9 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Marking volume 8ce624aa-611a-430c-8a6d-72003c8184b2 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Copying metadata from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a to 8ce624aa-611a-430c-8a6d-72003c8184b2. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Creating volume glance metadata for volume 8ce624aa-611a-430c-8a6d-72003c8184b2 backed by image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:53:03 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:03 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36e4ad-a4a1-41f4-b9bd-9550187ccf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce624aa-611a-430c-8a6d-72003c8184b2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5c2e96-017d-43ca-8cb4-cd9b4a0b42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Volume volume-8ce624aa-611a-430c-8a6d-72003c8184b2 (8ce624aa-611a-430c-8a6d-72003c8184b2): created successfully Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5c2e96-017d-43ca-8cb4-cd9b4a0b42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Flow 'volume_create_manager' (d12964ff-6905-4f00-a0f0-12cd2203ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-def75e1d-30be-496f-8126-98ab0ac101d6 tempest-ServerActionsTestOtherA-421397448 None] Created volume successfully. Aug 25 06:53:03 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.436s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:03 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.275s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Deleted volume successfully. Aug 25 06:53:03 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 Aug 25 06:53:03 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a642a21a-18e3-434e-aae0-e2b4c54c8bc2 tempest-VolumesTestJSON-545841676 None] Lock "cinder-97f75110-eb54-4a30-a6b6-116c7d607d80-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:04 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0" returned: 0 in 0.426s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:04 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0 Aug 25 06:53:04 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:04 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.5495231c-8a23-4341-a672-ca79f565b9d0" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-5495231c-8a23-4341-a672-ca79f565b9d0" released by "_delete_snapshot" :: held 1.689s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_snapshot" :: held 1.716s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Created reservations ['d185fcf6-f3f0-43d0-b947-5ceb7ad9318f', '27ff83fe-0a91-42a1-9eb6-3f3d4260dc5f', '2613b8ac-787f-4d8b-ae16-92aa8baf3669', '3b4e74dc-1c0f-4834-aba2-1eafdc9366b0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Delete snapshot completed successfully. Aug 25 06:53:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a4ba8e21-c377-4102-970f-7234d6e46e5a tempest-SnapshotsActionsTest-671119828 None] Lock "cinder-5495231c-8a23-4341-a672-ca79f565b9d0-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "cinder-57273b3f-9efd-4822-af0e-345acf983f18-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-57273b3f-9efd-4822-af0e-345acf983f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "cinder-quobyte-57273b3f-9efd-4822-af0e-345acf983f18" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-57273b3f-9efd-4822-af0e-345acf983f18" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Deleting offline snapshot 57273b3f-9efd-4822-af0e-345acf983f18 of volume 9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] snapshot_file for this snap is: volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b038f57-99bf-406e-906e-1db8d0aa5038]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:05 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:53:05 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:06 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.518s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dfb6e3-28a6-46e5-ac39-a9d202bd8370]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:06 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 Aug 25 06:53:06 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:06 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7" returned: 0 in 0.440s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:06 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:53:06 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:07 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.491s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:07 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18 Aug 25 06:53:07 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:07 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7.57273b3f-9efd-4822-af0e-345acf983f18" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-57273b3f-9efd-4822-af0e-345acf983f18" released by "_delete_snapshot" :: held 2.029s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_snapshot" :: held 2.082s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Created reservations ['f47b7b03-448a-419a-ae03-4f629c6a03f9', '65bd1d57-d3ca-441d-9d81-3488492a8c00', '32504aeb-75d7-4231-a1e1-03bdb633e437', '5d3a5d1f-825c-4809-9920-a78b14db553b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Delete snapshot completed successfully. Aug 25 06:53:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f35cb585-5c7e-4150-a2c9-809072a5a0b5 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-57273b3f-9efd-4822-af0e-345acf983f18-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-1a1d8c6b-474f-48f9-a4fd-4eff73e557c0 req-ae27d638-fa94-4fe8-8d80-3660066b7e35 tempest-AttachVolumeTestJSON-271035856 None] Terminate volume connection completed successfully. Aug 25 06:53:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-1a1d8c6b-474f-48f9-a4fd-4eff73e557c0 req-ae27d638-fa94-4fe8-8d80-3660066b7e35 tempest-AttachVolumeTestJSON-271035856 None] Deleting attachment baf0ed6e-30ce-4f66-ae54-c0260bc38117. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:53:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9bc7ea43-0cf6-4411-b389-1def09c6da7d req-e113c7df-d288-4c41-9fe1-33dfa0e50299 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9bc7ea43-0cf6-4411-b389-1def09c6da7d req-e113c7df-d288-4c41-9fe1-33dfa0e50299 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9bc7ea43-0cf6-4411-b389-1def09c6da7d req-e113c7df-d288-4c41-9fe1-33dfa0e50299 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9bc7ea43-0cf6-4411-b389-1def09c6da7d req-e113c7df-d288-4c41-9fe1-33dfa0e50299 tempest-ServerActionsTestOtherA-421397448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-8ce624aa-611a-430c-8a6d-72003c8184b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '619d955e-e876-433f-a766-68c96d446ef4', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:53:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9bc7ea43-0cf6-4411-b389-1def09c6da7d req-e113c7df-d288-4c41-9fe1-33dfa0e50299 tempest-ServerActionsTestOtherA-421397448 None] attachment_update completed successfully. Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "cinder-9aad69ff-5033-4ff8-8ec2-c190be3160d7-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-9aad69ff-5033-4ff8-8ec2-c190be3160d7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[963be56a-0965-489a-8040-96f174a2b107]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:09 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 Aug 25 06:53:09 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=111,cinder:UPDATE=103,cinder:INSERT=25,cinder:DELETE=9 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2c5abb40-c1ba-4497-9f09-4cabe1768b94 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-84570952: creating Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=119,cinder:UPDATE=103,cinder:INSERT=36,cinder:DELETE=8 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2c5abb40-c1ba-4497-9f09-4cabe1768b94 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-84570952: created successfully Aug 25 06:53:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2c5abb40-c1ba-4497-9f09-4cabe1768b94 tempest-GroupSnapshotsTest-1769840491 None] Create group completed successfully. Aug 25 06:53:09 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7" returned: 0 in 0.550s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:09 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7 Aug 25 06:53:09 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:10 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9aad69ff-5033-4ff8-8ec2-c190be3160d7" returned: 0 in 0.267s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-quobyte-9aad69ff-5033-4ff8-8ec2-c190be3160d7" released by "delete_volume" :: held 0.895s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Created reservations ['a32f3c69-ca73-49c9-a517-b830887d8134', '86adc6dc-f0af-4a5e-8c4e-7925e8dc1963', '0d7a8f68-956e-4923-b37c-2f9ceb4debc5', '4fad68c9-621a-4c3f-9fca-9aab2876e86f'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:10 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:10 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:10 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Deleted volume successfully. Aug 25 06:53:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d2937d0-49fd-47f0-a41c-2633413f8c92 tempest-SnapshotsActionsTest-1560088068 None] Lock "cinder-9aad69ff-5033-4ff8-8ec2-c190be3160d7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (e9b658a7-1dab-436b-8fed-5eed62cf42d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c1ea40-5270-4154-98df-d7a63e9ed550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c1ea40-5270-4154-98df-d7a63e9ed550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923172525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40f3c20-ef3b-4a14-912b-436a433b1c8f,host='devstack@QuobyteHD#QuobyteHD',id=45c839d1-aaf1-4325-a7a5-2380b30b7ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:11Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53d50442-6b8c-4cec-9a92-22835d0234bb),volume_type_id=53d50442-6b8c-4cec-9a92-22835d0234bb)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d45960-e42c-4162-bd5c-456826602980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d45960-e42c-4162-bd5c-456826602980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f974b35-631e-454a-ba94-30a95ff88a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f974b35-631e-454a-ba94-30a95ff88a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c839d1-aaf1-4325-a7a5-2380b30b7ccc', 'volume_name': 'volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3276457d-bc27-4063-9225-dbb710ffc91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3276457d-bc27-4063-9225-dbb710ffc91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279bedaa-6815-4bec-8921-86b47e36bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:11 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Volume 45c839d1-aaf1-4325-a7a5-2380b30b7ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc', 'volume_size': 1} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a40f3c20-ef3b-4a14-912b-436a433b1c8f,created_at=2026-08-25T04:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923172525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40f3c20-ef3b-4a14-912b-436a433b1c8f,host='devstack@QuobyteHD#QuobyteHD',id=45c839d1-aaf1-4325-a7a5-2380b30b7ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:11Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53d50442-6b8c-4cec-9a92-22835d0234bb),volume_type_id=53d50442-6b8c-4cec-9a92-22835d0234bb)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Creating volume 45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:11 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:53:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:11 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc 1073741824 Aug 25 06:53:11 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:12 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc 1073741824" returned: 0 in 0.848s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:12 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:12 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:13 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.599s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279bedaa-6815-4bec-8921-86b47e36bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f00763f-3806-43fc-a4c4-2dcdf35456b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Volume volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc (45c839d1-aaf1-4325-a7a5-2380b30b7ccc): created successfully Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f00763f-3806-43fc-a4c4-2dcdf35456b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (e9b658a7-1dab-436b-8fed-5eed62cf42d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:13 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cee7b3bc-269e-47f9-85e5-7d0058a5bc69 tempest-GroupSnapshotsTest-1769840491 None] Created volume successfully. Aug 25 06:53:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] GroupSnapshot e46dd39d-9224-4934-bc8b-13e488edc361: creating. Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Group snapshot e46dd39d-9224-4934-bc8b-13e488edc361: creating. {{(pid=94487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Creating offline snapshot ec5f4200-1674-41a3-9d86-821eb89e487f of volume 45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b2719-379a-42f5-b6a8-eba28cdd1370]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:14 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:14 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:15 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.711s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:15 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f 1G Aug 25 06:53:15 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:16 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f 1G" returned: 0 in 0.687s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:16 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:16 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:16 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.786s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:16 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:53:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:16 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:16 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:17 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.412s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:17 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info Aug 25 06:53:17 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:17 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:17 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:53:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:17 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info Aug 25 06:53:17 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:18 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.info" returned: 0 in 0.495s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b165e2c6-98a9-4f10-9c77-6b712f9e9934 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot e46dd39d-9224-4934-bc8b-13e488edc361: created successfully Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Creating volume 2ae106c0-9283-4ef5-9832-5d9c1166c5f0 from snapshot ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] snapshot: ec5f4200-1674-41a3-9d86-821eb89e487f, volume: 2ae106c0-9283-4ef5-9832-5d9c1166c5f0, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[45377103-adb3-43e3-8bfa-493ac1f5d449]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:21 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:21 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:21 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.824s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6413c1f-7750-4112-a349-bd96cb2845cb]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:22 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:22 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:22 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.537s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:53:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:53:22 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:53:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:22 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 Aug 25 06:53:22 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:30 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:30 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:33 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" returned: 0 in 11.181s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc, size 1024.00 MB, duration 11.18 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:53:33 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Converted 1024.00 MB image at 91.57 MB/s Aug 25 06:53:33 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:33 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 Aug 25 06:53:33 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:33 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" returned: 0 in 0.322s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" released by "_copy_volume_from_snapshot" :: held 13.075s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" released by "_create_volume_from_snapshot" :: held 13.185s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.239s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c9475cd1-5697-41fd-bf9e-9571c66c25f0 tempest-GroupSnapshotsTest-1769840491 None] Create group from source-snapshot-e46dd39d-9224-4934-bc8b-13e488edc361 completed successfully. Aug 25 06:53:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be2a6a-feef-44c1-ad4e-4ee5aeae54d1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:35 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 Aug 25 06:53:35 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" returned: 0 in 0.678s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:36 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0 Aug 25 06:53:36 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-a0a67da8-3c99-45af-b3f5-d431d657f892 tempest-ServerActionsTestOtherA-421397448 None] Terminate volume connection completed successfully. Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-a0a67da8-3c99-45af-b3f5-d431d657f892 tempest-ServerActionsTestOtherA-421397448 None] Deleting attachment 619d955e-e876-433f-a766-68c96d446ef4. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:53:36 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" returned: 0 in 0.365s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-2ae106c0-9283-4ef5-9832-5d9c1166c5f0" released by "delete_volume" :: held 1.115s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:36 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['f8a08e6c-6a74-4188-a38b-22aa8a7742ff'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:37 devstack cinder-volume[94487]: WARNING cinder.quota [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-812129923 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-812129923, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:37 devstack cinder-volume[94487]: WARNING cinder.quota [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-812129923 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-812129923, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['c6525fdb-8223-4fdc-b686-0594faba2c73', 'debd5225-1d6c-4601-aba8-178a2d6dd5d0', '30cda5c4-811d-42fc-9997-645cb314d3c4', '7e49ecd2-3b97-4c0e-9984-28607d2d0b94'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:37 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:37 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:37 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:37 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3a053e72-6e76-4341-bb28-bec14a381efc tempest-GroupSnapshotsTest-1769840491 None] Delete group completed successfully. Aug 25 06:53:38 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot e46dd39d-9224-4934-bc8b-13e488edc361: deleting Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot e46dd39d-9224-4934-bc8b-13e488edc361: deleting {{(pid=94487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-212dccb0-7266-463b-8e6b-8a5cba34d7a7 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-212dccb0-7266-463b-8e6b-8a5cba34d7a7 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Deleting offline snapshot ec5f4200-1674-41a3-9d86-821eb89e487f of volume 45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] snapshot_file for this snap is: volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-212dccb0-7266-463b-8e6b-8a5cba34d7a7 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9466f0-07ab-4f9d-8501-240feea1b6d6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-212dccb0-7266-463b-8e6b-8a5cba34d7a7 tempest-ServerActionsTestOtherA-421397448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-8ce624aa-611a-430c-8a6d-72003c8184b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1a8f2ec-4e31-4e54-8c0d-81aa0c5e2a8b', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:53:38 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:38 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:38 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-c859bdae-43ef-4796-a092-f19a42d48c33 req-212dccb0-7266-463b-8e6b-8a5cba34d7a7 tempest-ServerActionsTestOtherA-421397448 None] attachment_update completed successfully. Aug 25 06:53:39 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.729s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Flow 'volume_create_manager' (010da879-dc29-497c-a2fd-9b149ff0b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc433a8e-a166-446d-82b4-32b675059c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa304f-0414-4900-baa0-285ad7ea59a7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc433a8e-a166-446d-82b4-32b675059c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-546861160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae1acc6-f152-4c19-bd02-50a592c1a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7d16ffa314685a07c5cde3a59d05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:39Z,use_quota=True,user_id='45eb82970aeb4abca8c677c63d9e4f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914b2c05-c8de-4088-aa99-2eb14cf47ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914b2c05-c8de-4088-aa99-2eb14cf47ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbf4d91-d65e-4f5a-81d9-6ee728cda203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbf4d91-d65e-4f5a-81d9-6ee728cda203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae1acc6-f152-4c19-bd02-50a592c1a4e2', 'volume_name': 'volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f2ac1-c417-4d65-af05-02f2d56ef280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f2ac1-c417-4d65-af05-02f2d56ef280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365413b3-b2d1-4ba2-9413-2b11cd3ea393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume dae1acc6-f152-4c19-bd02-50a592c1a4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2', 'volume_size': 1} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-546861160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae1acc6-f152-4c19-bd02-50a592c1a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7d16ffa314685a07c5cde3a59d05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:39Z,use_quota=True,user_id='45eb82970aeb4abca8c677c63d9e4f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Creating volume dae1acc6-f152-4c19-bd02-50a592c1a4e2 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:39 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:53:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:39 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 1073741824 Aug 25 06:53:39 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:39 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:39 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:40 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.748s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:40 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 1073741824" returned: 0 in 0.684s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:40 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:40 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:40 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 Aug 25 06:53:40 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:40 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2" returned: 0 in 0.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365413b3-b2d1-4ba2-9413-2b11cd3ea393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f7b0f-e915-4f9a-a2af-983fc59f9e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:40 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:40 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 (dae1acc6-f152-4c19-bd02-50a592c1a4e2): created successfully Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f7b0f-e915-4f9a-a2af-983fc59f9e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Flow 'volume_create_manager' (010da879-dc29-497c-a2fd-9b149ff0b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.534s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:40 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c1fa68e9-6437-47fb-b87b-253281c000b7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Created volume successfully. Aug 25 06:53:40 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f Aug 25 06:53:40 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:40 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc.ec5f4200-1674-41a3-9d86-821eb89e487f" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ec5f4200-1674-41a3-9d86-821eb89e487f" released by "_delete_snapshot" :: held 2.448s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" released by "delete_snapshot" :: held 2.491s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:40 devstack cinder-volume[94487]: WARNING cinder.quota [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-812129923 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-812129923, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['a09b85a0-8308-48a5-beda-862f92c46a94', '7cb48010-90e0-490e-8c52-9af93af4c443', '389b06d1-b90c-400c-9eb6-75418b81f900', '857cfc77-15e2-4bd0-8405-52d68d587731'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a14ae9d3-8e04-4c50-8ca7-2be44d106946 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot e46dd39d-9224-4934-bc8b-13e488edc361: deleted successfully Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "cinder-dae1acc6-f152-4c19-bd02-50a592c1a4e2-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "cinder-dae1acc6-f152-4c19-bd02-50a592c1a4e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "cinder-quobyte-dae1acc6-f152-4c19-bd02-50a592c1a4e2" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "cinder-quobyte-dae1acc6-f152-4c19-bd02-50a592c1a4e2" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862801f-6457-4f3a-a199-d5f1a9f980ca]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:41 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 Aug 25 06:53:41 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[27425880-eca3-4c37-9e7f-569d1b3f4c8e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:42 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:42 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:42 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2" returned: 0 in 0.750s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:42 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2 Aug 25 06:53:42 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:42 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.955s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:43 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:43 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dae1acc6-f152-4c19-bd02-50a592c1a4e2" returned: 0 in 0.466s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:43 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "cinder-quobyte-dae1acc6-f152-4c19-bd02-50a592c1a4e2" released by "delete_volume" :: held 1.330s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Created reservations ['400f48ae-4fd2-48ad-a01b-427dae882a4a', '7ef64def-6cb2-4274-9f75-5209e249dd00', '40b205d7-20a1-4dbb-887f-24ada79c4e04', '55eea90c-c78c-48c0-a072-1df8de39b1e1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:43 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:43 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:43 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" returned: 0 in 0.828s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-45c839d1-aaf1-4325-a7a5-2380b30b7ccc" released by "delete_volume" :: held 1.918s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['4091d42a-3cc4-4c0d-8118-7e1b30686ed0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:43 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.514s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:43 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Deleted volume successfully. Aug 25 06:53:44 devstack cinder-volume[94487]: WARNING cinder.db.api [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-812129923'] Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['55af585d-8ad2-42dd-836c-3df1d1ec8047', 'ccb009fd-4b10-486e-9063-5b1997a97c5f', '79d99b39-ef67-4e52-afa6-5782aacb59a6', 'fe904bd5-91c9-4ab1-9744-6b62865b0259'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-06aedea8-47c8-474c-8c4d-6be9eb34f4d7 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "cinder-dae1acc6-f152-4c19-bd02-50a592c1a4e2-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:44 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:44 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:44 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:44 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b893691e-651d-4509-9bab-8c6a86187ff4 tempest-GroupSnapshotsTest-1769840491 None] Delete group completed successfully. Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Flow 'volume_create_manager' (86674886-f837-44b9-bd15-b9627d87542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999536f-adee-4597-a627-f955f6586a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-395dcf9f-bbe6-4777-b813-83559105a8d0 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-1906768665: creating Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999536f-adee-4597-a627-f955f6586a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1142502057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66a7d6f-1a2e-478a-862a-c58ba724f86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7d16ffa314685a07c5cde3a59d05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:45Z,use_quota=True,user_id='45eb82970aeb4abca8c677c63d9e4f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36104bf7-a995-48b4-b17c-87616362e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36104bf7-a995-48b4-b17c-87616362e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db019f-d495-407d-8a6e-6a5e76494cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db019f-d495-407d-8a6e-6a5e76494cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66a7d6f-1a2e-478a-862a-c58ba724f86c', 'volume_name': 'volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0283fcb1-d048-41d9-a211-49f4a702e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0283fcb1-d048-41d9-a211-49f4a702e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f71aee-a27a-4b92-bd79-da2309f0a175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume b66a7d6f-1a2e-478a-862a-c58ba724f86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c', 'volume_size': 1} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1142502057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66a7d6f-1a2e-478a-862a-c58ba724f86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7d16ffa314685a07c5cde3a59d05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:45Z,use_quota=True,user_id='45eb82970aeb4abca8c677c63d9e4f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Creating volume b66a7d6f-1a2e-478a-862a-c58ba724f86c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:45 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:53:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:45 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c 1073741824 Aug 25 06:53:45 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-395dcf9f-bbe6-4777-b813-83559105a8d0 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-1906768665: created successfully Aug 25 06:53:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-395dcf9f-bbe6-4777-b813-83559105a8d0 tempest-GroupSnapshotsTest-1769840491 None] Create group completed successfully. Aug 25 06:53:46 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c 1073741824" returned: 0 in 0.823s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:46 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c Aug 25 06:53:46 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:47 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c" returned: 0 in 0.530s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f71aee-a27a-4b92-bd79-da2309f0a175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4156ce0e-0c78-43d3-bb74-abd45589ea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Volume volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c (b66a7d6f-1a2e-478a-862a-c58ba724f86c): created successfully Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4156ce0e-0c78-43d3-bb74-abd45589ea0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Flow 'volume_create_manager' (86674886-f837-44b9-bd15-b9627d87542b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:47 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4c645d00-b07b-4d40-8175-813be2728ec1 tempest-VolumeQuotasAdminTestJSON-1267038543 None] Created volume successfully. Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (1322e0d5-a461-40ec-ad96-4d17b716dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c21910f-f845-4124-8366-5aeaf80354b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c21910f-f845-4124-8366-5aeaf80354b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524216193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,host='devstack@QuobyteHD#QuobyteHD',id=b9e94158-b3b0-4d00-8501-cedfcff05d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:48Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4db4af-5c0a-48b8-87e5-8406dc87b4e6),volume_type_id=ae4db4af-5c0a-48b8-87e5-8406dc87b4e6)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a7c9e8-77c9-469b-999c-7a5eab602504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a7c9e8-77c9-469b-999c-7a5eab602504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01493ae7-c72d-448d-ab37-f5270b65ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01493ae7-c72d-448d-ab37-f5270b65ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e94158-b3b0-4d00-8501-cedfcff05d9b', 'volume_name': 'volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd1d6cb-e5e6-44ea-b3e7-b89b622bf6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd1d6cb-e5e6-44ea-b3e7-b89b622bf6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82cd9e-afee-40ad-b350-011301352c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Volume b9e94158-b3b0-4d00-8501-cedfcff05d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b', 'volume_size': 1} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,created_at=2026-08-25T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524216193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,host='devstack@QuobyteHD#QuobyteHD',id=b9e94158-b3b0-4d00-8501-cedfcff05d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:48Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4db4af-5c0a-48b8-87e5-8406dc87b4e6),volume_type_id=ae4db4af-5c0a-48b8-87e5-8406dc87b4e6)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Creating volume b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:48 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:48 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b 1073741824 Aug 25 06:53:48 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:48 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b 1073741824" returned: 0 in 0.860s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:49 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b Aug 25 06:53:49 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:49 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b" returned: 0 in 0.762s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82cd9e-afee-40ad-b350-011301352c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f30336-629b-4028-bb70-a572ca76ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Volume volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b (b9e94158-b3b0-4d00-8501-cedfcff05d9b): created successfully Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f30336-629b-4028-bb70-a572ca76ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (1322e0d5-a461-40ec-ad96-4d17b716dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-295cd067-4e7a-4382-a115-26056bfa8113 tempest-VolumeQuotasAdminTestJSON-17643503 None] Transfer volume completed successfully. Aug 25 06:53:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a5529d96-8bb3-469d-ad87-c957515967bc tempest-GroupSnapshotsTest-1769840491 None] Created volume successfully. Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Acquiring lock "cinder-b66a7d6f-1a2e-478a-862a-c58ba724f86c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "cinder-b66a7d6f-1a2e-478a-862a-c58ba724f86c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Acquiring lock "cinder-quobyte-b66a7d6f-1a2e-478a-862a-c58ba724f86c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "cinder-quobyte-b66a7d6f-1a2e-478a-862a-c58ba724f86c" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b057c0f-0d6c-474a-85ea-7b4bd5cddd33]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:50 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c Aug 25 06:53:50 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:51 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c" returned: 0 in 0.563s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:51 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c Aug 25 06:53:51 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (829968a8-fb19-4ac4-8cf2-60cda48c8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71df5134-26d0-4362-91e6-1f3bb62a1443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71df5134-26d0-4362-91e6-1f3bb62a1443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165397905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,host='devstack@QuobyteHD#QuobyteHD',id=8bef50bf-05b5-4c3b-8979-e03cfddb2878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:51Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4db4af-5c0a-48b8-87e5-8406dc87b4e6),volume_type_id=ae4db4af-5c0a-48b8-87e5-8406dc87b4e6)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713fa01-00f5-497b-8582-dc59513feada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713fa01-00f5-497b-8582-dc59513feada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f80de58-542c-43d1-853c-d82bb20ae1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f80de58-542c-43d1-853c-d82bb20ae1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bef50bf-05b5-4c3b-8979-e03cfddb2878', 'volume_name': 'volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360bab6d-f795-4559-92c0-8df6c5201735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360bab6d-f795-4559-92c0-8df6c5201735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c57738-5475-40fb-8359-7baab71180f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Volume 8bef50bf-05b5-4c3b-8979-e03cfddb2878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878', 'volume_size': 1} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,created_at=2026-08-25T04:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165397905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3720c9e-e848-4050-a441-b9e7e9beb85a,host='devstack@QuobyteHD#QuobyteHD',id=8bef50bf-05b5-4c3b-8979-e03cfddb2878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:51Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4db4af-5c0a-48b8-87e5-8406dc87b4e6),volume_type_id=ae4db4af-5c0a-48b8-87e5-8406dc87b4e6)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Creating volume 8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:51 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b66a7d6f-1a2e-478a-862a-c58ba724f86c" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "cinder-quobyte-b66a7d6f-1a2e-478a-862a-c58ba724f86c" released by "delete_volume" :: held 0.974s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:51 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 1073741824 Aug 25 06:53:51 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Created reservations ['4d6defa7-cf95-44c8-8299-9b026dfcaaa0', 'd8341774-1889-4f53-85b4-41efd9801f89', '8b6f23f8-7977-40b6-801c-605dc38aa7e1', '27815c77-3f54-4084-9c7f-325f3fccdff2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:51 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:53:51 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:52 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.309s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Deleted volume successfully. Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d262e87-b637-427b-a537-ea9a6dbc0299 tempest-VolumeQuotasAdminTestJSON-1420971013 None] Lock "cinder-b66a7d6f-1a2e-478a-862a-c58ba724f86c-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:52 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 1073741824" returned: 0 in 0.652s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:52 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 Aug 25 06:53:52 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:52 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c57738-5475-40fb-8359-7baab71180f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aa4dc7-3967-49bb-b08e-47405b68a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Volume volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 (8bef50bf-05b5-4c3b-8979-e03cfddb2878): created successfully Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aa4dc7-3967-49bb-b08e-47405b68a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (829968a8-fb19-4ac4-8cf2-60cda48c8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b9a9bcc7-b1eb-4c50-be1e-f270aae00613 tempest-GroupSnapshotsTest-1769840491 None] Created volume successfully. Aug 25 06:53:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0abfb639-165b-420f-9e16-71a589ff60ab tempest-GroupSnapshotsTest-1769840491 None] Update group completed successfully. Aug 25 06:53:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f3f832ca-348f-4f0a-89f7-b0dc5ae4d198 tempest-GroupSnapshotsTest-1769840491 None] Update group completed successfully. Aug 25 06:53:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-90e4ecca-142b-43b1-8b5e-6ce248779227 tempest-GroupSnapshotsTest-1769840491 None] Update group completed successfully. Aug 25 06:53:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-52ce89a1-adf8-43b7-9b8d-c62ace68453d tempest-GroupSnapshotsTest-1769840491 None] Update group completed successfully. Aug 25 06:54:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] GroupSnapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: creating. Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Group snapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: creating. {{(pid=94487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Creating offline snapshot 43c79ebc-3923-46fb-bdf1-eae742122ab3 of volume b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e970525-bccf-4302-bab5-d715e2551173]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:00 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b Aug 25 06:54:00 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:00 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:00 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:00 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b" returned: 0 in 0.615s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:00 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 1G Aug 25 06:54:00 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:01 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.513s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:54:01 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 1G" returned: 0 in 0.632s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:01 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 Aug 25 06:54:01 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:01 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:01 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:01 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 Aug 25 06:54:01 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:02 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:02 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info Aug 25 06:54:02 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:02 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:02 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:02 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info Aug 25 06:54:02 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:03 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.info" returned: 0 in 0.284s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Creating offline snapshot 7db05f27-a1aa-4acf-868a-2521aa6f4da4 of volume 8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4428d3b-a3d9-4ee0-828c-30fd5fa875a5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:03 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 Aug 25 06:54:03 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:03 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878" returned: 0 in 0.554s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:03 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 1G Aug 25 06:54:03 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:04 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 1G" returned: 0 in 0.653s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:04 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 Aug 25 06:54:04 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:04 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4" returned: 0 in 0.444s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:04 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:04 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 Aug 25 06:54:04 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:05 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:05 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info Aug 25 06:54:05 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:05 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info" returned: 0 in 0.389s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:05 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info Aug 25 06:54:05 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:05 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.info" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-113fecaf-01d4-45e6-8a9c-6ef054c96eb2 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: created successfully Aug 25 06:54:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] group_snapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: deleting Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] group_snapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: deleting {{(pid=94487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-43c79ebc-3923-46fb-bdf1-eae742122ab3" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-43c79ebc-3923-46fb-bdf1-eae742122ab3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Deleting offline snapshot 43c79ebc-3923-46fb-bdf1-eae742122ab3 of volume b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] snapshot_file for this snap is: volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9bc5b-1450-4701-bc25-a0c602fb92c1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:07 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 Aug 25 06:54:07 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:07 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3" returned: 0 in 0.461s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f9afb-8c8a-47b6-80ac-0a3e5a10c689]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:07 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b Aug 25 06:54:07 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:07 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:07 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 Aug 25 06:54:07 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:08 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3" returned: 0 in 0.496s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:08 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3 Aug 25 06:54:08 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:08 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b.43c79ebc-3923-46fb-bdf1-eae742122ab3" returned: 0 in 0.331s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-43c79ebc-3923-46fb-bdf1-eae742122ab3" released by "_delete_snapshot" :: held 1.825s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" released by "delete_snapshot" :: held 1.859s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-7db05f27-a1aa-4acf-868a-2521aa6f4da4" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-7db05f27-a1aa-4acf-868a-2521aa6f4da4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Deleting offline snapshot 7db05f27-a1aa-4acf-868a-2521aa6f4da4 of volume 8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] snapshot_file for this snap is: volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9205373-3b86-4eb6-9f91-7d0a1e0770b2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:09 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 Aug 25 06:54:09 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:09 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4" returned: 0 in 0.548s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42ea3d-b2e0-4352-87d9-e0c9c1e513b4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:09 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 Aug 25 06:54:09 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878" returned: 0 in 0.612s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 Aug 25 06:54:10 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4" returned: 0 in 0.456s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4 Aug 25 06:54:10 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878.7db05f27-a1aa-4acf-868a-2521aa6f4da4" returned: 0 in 0.285s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-7db05f27-a1aa-4acf-868a-2521aa6f4da4" released by "_delete_snapshot" :: held 2.033s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" released by "delete_snapshot" :: held 2.066s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:10 devstack cinder-volume[94487]: WARNING cinder.quota [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-16437478 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-16437478, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:10 devstack cinder-volume[94487]: WARNING cinder.quota [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-16437478 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-16437478, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:11 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['53cf251f-ce8c-4959-b9c3-d72231c28f54', 'aeb8d75b-bb91-4ba6-b9a6-02c697669d1b', 'ddc40a97-e387-4986-968f-cb58382da8ab', 'faba1330-8b72-4a63-bc26-c9b73c0e5369'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:11 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['77783e4d-d300-4184-84b1-ea45ac916e27', 'fe4ab811-9164-41f7-ab8a-cee794da7264', 'fec3270c-ad18-4b71-b9bf-5313be69ccca', '983da9a8-04aa-486e-931b-bd6870c4456b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2ea23e57-bca4-408e-a858-d891e808ad0d tempest-GroupSnapshotsTest-1769840491 None] group_snapshot 99e3ec39-cca8-4f5a-89dc-a8bac878079a: deleted successfully Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" acquired by "delete_volume" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72235b-51b1-47bb-a979-7d718630108a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:12 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 Aug 25 06:54:12 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878" returned: 0 in 0.519s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:12 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878 Aug 25 06:54:12 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8bef50bf-05b5-4c3b-8979-e03cfddb2878" returned: 0 in 0.339s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-8bef50bf-05b5-4c3b-8979-e03cfddb2878" released by "delete_volume" :: held 0.936s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d6f38e-f15e-4862-848b-cbda42794768]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b Aug 25 06:54:13 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Flow 'volume_create_manager' (6501c49d-e1f9-4724-88fc-caa36b42994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30c7bd-d3f8-4359-8974-f3bbd0a5854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30c7bd-d3f8-4359-8974-f3bbd0a5854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-424628191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6406a1-22d5-4967-b0e6-d12cc56c770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a63e85d85549cb83675757a34ddf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:14Z,use_quota=True,user_id='e67fdca729f74d5799240543cb39566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a14349-aa96-4424-9dee-71d15e32efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a14349-aa96-4424-9dee-71d15e32efd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c09666-ecdc-4be7-b422-b9c3cfdd117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:54:13 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b" returned: 0 in 0.725s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b Aug 25 06:54:13 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b9e94158-b3b0-4d00-8501-cedfcff05d9b" returned: 0 in 0.601s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c09666-ecdc-4be7-b422-b9c3cfdd117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d6406a1-22d5-4967-b0e6-d12cc56c770a', 'volume_name': 'volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3247fe4-152b-46cb-a75e-0c8a45c6eadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3247fe4-152b-46cb-a75e-0c8a45c6eadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05119bee-f6db-4621-b6ca-83e3459250f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Trying to clone 4d6406a1-22d5-4967-b0e6-d12cc56c770a from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-b9e94158-b3b0-4d00-8501-cedfcff05d9b" released by "delete_volume" :: held 1.503s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['adcff99e-4904-4518-a267-ab9f7e2416db'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:14 devstack cinder-volume[94487]: WARNING cinder.quota [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-16437478 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-16437478, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:14 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:54:14 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['5de2096b-5282-4ff0-b1b8-eb3c1cdf9832', '72c085d1-b32d-49da-9f6c-66aa03b1c3e5', 'bb2f1f54-be91-47f5-ba87-3d6dddb5344f', '5c27fa17-de06-482d-b7dd-624fd610a0e9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d615b065-38f9-4977-9d22-6361d57ee6d9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['8705f09b-c842-4bbe-b166-42ee236910ca', 'c3879ad8-0dec-499a-aa93-c8128a03f0c4', '6c03251d-0f9d-47fd-bf8f-5f65bc912c8f', '1276144c-cc3c-445f-b03f-2b33442ec214'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:15 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD Aug 25 06:54:15 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:15 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a is fetched for user e67fdca729f74d5799240543cb39566e. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e967ae-c654-4738-8c66-5b4b35c5a489]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.325s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-004407ec-2b6a-48ff-801a-f9360974656c tempest-GroupSnapshotsTest-1769840491 None] Delete group completed successfully. Aug 25 06:54:15 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD Aug 25 06:54:15 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-424628191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6406a1-22d5-4967-b0e6-d12cc56c770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a63e85d85549cb83675757a34ddf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:14Z,use_quota=True,user_id='e67fdca729f74d5799240543cb39566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Creating volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:15 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1073741824 Aug 25 06:54:15 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-0828e6e4-21fe-47ef-87c6-c3bcff2f0846 tempest-ServerActionsTestOtherA-421397448 None] Terminate volume connection completed successfully. Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-0828e6e4-21fe-47ef-87c6-c3bcff2f0846 tempest-ServerActionsTestOtherA-421397448 None] Deleting attachment b1a8f2ec-4e31-4e54-8c0d-81aa0c5e2a8b. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "cinder-8ce624aa-611a-430c-8a6d-72003c8184b2-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-8ce624aa-611a-430c-8a6d-72003c8184b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:16 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "cinder-quobyte-8ce624aa-611a-430c-8a6d-72003c8184b2" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1073741824" returned: 0 in 0.622s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-quobyte-8ce624aa-611a-430c-8a6d-72003c8184b2" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb7abb-377d-4896-b79b-cb0a71cec6f5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c92b41ec-e0fd-4132-b1e3-b36726fff908 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-23941676: creating Aug 25 06:54:16 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a Aug 25 06:54:16 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c92b41ec-e0fd-4132-b1e3-b36726fff908 tempest-GroupSnapshotsTest-1769840491 None] Group tempest-GroupSnapshotsTest-Group-23941676: created successfully Aug 25 06:54:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c92b41ec-e0fd-4132-b1e3-b36726fff908 tempest-GroupSnapshotsTest-1769840491 None] Create group completed successfully. Aug 25 06:54:16 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 Aug 25 06:54:16 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:16 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a" returned: 0 in 0.280s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Attempting download of 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d673b5-74d1-48ce-99b9-cc52eb60c14e]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2 Aug 25 06:54:17 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg Aug 25 06:54:17 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce624aa-611a-430c-8a6d-72003c8184b2" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-quobyte-8ce624aa-611a-430c-8a6d-72003c8184b2" released by "delete_volume" :: held 0.803s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "cinder-933b03ca-98d2-44e0-9e8f-595b095bf33f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-933b03ca-98d2-44e0-9e8f-595b095bf33f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.quota [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Created reservations ['2408f366-255c-4add-a9d2-c5af17c017dd', 'e46f5dd2-224c-4ad7-9d92-eabdccc0166f', '1d4e2801-6c6e-4314-b9cd-29e4e3299e93', 'fd009965-ccea-4846-b5bb-b568be722104'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "cinder-quobyte-933b03ca-98d2-44e0-9e8f-595b095bf33f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:17 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg Aug 25 06:54:17 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-quobyte-933b03ca-98d2-44e0-9e8f-595b095bf33f" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ed4f5-0edb-4f8f-b2e9-02a5b2549c72]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:17 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f Aug 25 06:54:17 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg" returned: 1 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_tnz9tpdg' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbb702-30b9-403c-b8f7-c81fbb9ea8cc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD Aug 25 06:54:17 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.334s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.manager [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Deleted volume successfully. Aug 25 06:54:17 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f" returned: 0 in 0.408s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-9a59dc09-83b3-4c9a-8095-e2d2fd4f58f5 req-af9bbb34-00a2-41c0-9433-2603b2a7e755 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-8ce624aa-611a-430c-8a6d-72003c8184b2-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:17 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f Aug 25 06:54:17 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:18 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:18 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a Aug 25 06:54:18 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:18 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-933b03ca-98d2-44e0-9e8f-595b095bf33f" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-quobyte-933b03ca-98d2-44e0-9e8f-595b095bf33f" released by "delete_volume" :: held 0.766s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (9db2e0ae-aacc-4aeb-9ce2-8222f3682dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9f81e0-219c-427c-9d57-82734868917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9f81e0-219c-427c-9d57-82734868917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d9892d8-4f84-4295-a1d4-49b1363459f5,host='devstack@QuobyteHD#QuobyteHD',id=290c15fc-c8df-461c-afd9-021bc4ddce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:18Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81b2de1-ad02-460a-81a8-0dfb2a81a2f5),volume_type_id=b81b2de1-ad02-460a-81a8-0dfb2a81a2f5)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6253135c-cf7c-41e4-8c60-d3e4afe144bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6253135c-cf7c-41e4-8c60-d3e4afe144bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e5fd7e-7c36-437d-9830-dee7dbe7e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e5fd7e-7c36-437d-9830-dee7dbe7e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290c15fc-c8df-461c-afd9-021bc4ddce3b', 'volume_name': 'volume-290c15fc-c8df-461c-afd9-021bc4ddce3b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4632fe1d-e04f-4906-9962-3777b09fdef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4632fe1d-e04f-4906-9962-3777b09fdef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002016ee-3c31-417a-9021-21b07a9b7bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Volume 290c15fc-c8df-461c-afd9-021bc4ddce3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290c15fc-c8df-461c-afd9-021bc4ddce3b', 'volume_size': 1} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d9892d8-4f84-4295-a1d4-49b1363459f5,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d9892d8-4f84-4295-a1d4-49b1363459f5,host='devstack@QuobyteHD#QuobyteHD',id=290c15fc-c8df-461c-afd9-021bc4ddce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a484b1672654ed4bcb1cc405127cee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:18Z,use_quota=True,user_id='6f74d9482b7d4a308278cc95a673cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81b2de1-ad02-460a-81a8-0dfb2a81a2f5),volume_type_id=b81b2de1-ad02-460a-81a8-0dfb2a81a2f5)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Creating volume 290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:18 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:18 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b 1073741824 Aug 25 06:54:18 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Created reservations ['2bffff69-9bc0-4390-a93a-a65bf3b082e2', 'b4a1780e-1f69-4697-9547-0b012bd6c7c6', '5440d099-8a0e-4c90-b5ef-c62db5770a2d', '3a577025-a265-463c-8420-c9d66cbbc990'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:18 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:18 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:18 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.369s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Deleted volume successfully. Aug 25 06:54:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64c31e9e-fdb3-48cd-80d9-a1a652c5c534 tempest-ServerActionsTestOtherA-421397448 None] Lock "cinder-933b03ca-98d2-44e0-9e8f-595b095bf33f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:19 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b 1073741824" returned: 0 in 0.606s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:19 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b Aug 25 06:54:19 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:19 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b" returned: 0 in 0.433s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002016ee-3c31-417a-9021-21b07a9b7bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290c15fc-c8df-461c-afd9-021bc4ddce3b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615c6c41-d2db-4f9b-afdc-6e50ce247949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Volume volume-290c15fc-c8df-461c-afd9-021bc4ddce3b (290c15fc-c8df-461c-afd9-021bc4ddce3b): created successfully Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615c6c41-d2db-4f9b-afdc-6e50ce247949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Flow 'volume_create_manager' (9db2e0ae-aacc-4aeb-9ce2-8222f3682dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-345299b9-f4e0-4701-a3eb-6917bb7ff517 tempest-GroupSnapshotsTest-1769840491 None] Created volume successfully. Aug 25 06:54:20 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a" returned: 0 in 2.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_di2zbli8devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:54:20 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Converted 112.00 MB image at 47.56 MB/s Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:20 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1G Aug 25 06:54:20 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:20 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a 1G" returned: 0 in 0.447s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Downloaded image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a for user e67fdca729f74d5799240543cb39566e is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:54:20 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Marking volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Copying metadata from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a to 4d6406a1-22d5-4967-b0e6-d12cc56c770a. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Creating volume glance metadata for volume 4d6406a1-22d5-4967-b0e6-d12cc56c770a backed by image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05119bee-f6db-4621-b6ca-83e3459250f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02beb8e-7162-4d0d-b5cb-cc15bae6e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] GroupSnapshot cbf4e90a-fea5-466d-8798-850225681d75: creating. Aug 25 06:54:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Volume volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a (4d6406a1-22d5-4967-b0e6-d12cc56c770a): created successfully Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02beb8e-7162-4d0d-b5cb-cc15bae6e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Flow 'volume_create_manager' (6501c49d-e1f9-4724-88fc-caa36b42994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c6ab36aa-6321-4e92-866d-ad5fb9141539 tempest-VolumesImageMetadata-971366562 None] Created volume successfully. Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Group snapshot cbf4e90a-fea5-466d-8798-850225681d75: creating. {{(pid=94487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Creating offline snapshot ce55b5f8-209a-43e6-adcf-a5786c8a57fd of volume 290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef7211-a39e-4da3-9cde-4ec75aee284d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:21 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b Aug 25 06:54:21 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:21 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b" returned: 0 in 0.445s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:21 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd 1G Aug 25 06:54:21 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:22 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd 1G" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290c15fc-c8df-461c-afd9-021bc4ddce3b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290c15fc-c8df-461c-afd9-021bc4ddce3b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd Aug 25 06:54:22 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:22 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290c15fc-c8df-461c-afd9-021bc4ddce3b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd" returned: 0 in 0.387s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:22 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd Aug 25 06:54:22 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Acquiring lock "cinder-4d6406a1-22d5-4967-b0e6-d12cc56c770a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "cinder-4d6406a1-22d5-4967-b0e6-d12cc56c770a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Acquiring lock "cinder-quobyte-4d6406a1-22d5-4967-b0e6-d12cc56c770a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "cinder-quobyte-4d6406a1-22d5-4967-b0e6-d12cc56c770a" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:22 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd" returned: 0 in 0.315s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[33daad26-1ffb-4bf7-82ae-72e4b8cb826e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info Aug 25 06:54:22 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:23 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a Aug 25 06:54:23 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:23 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:23 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info Aug 25 06:54:23 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:23 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a" returned: 0 in 0.428s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:23 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a Aug 25 06:54:23 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:23 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.info" returned: 0 in 0.335s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e03c3c73-1daf-4be3-9cc4-20d9277e85fe tempest-GroupSnapshotsTest-1769840491 None] group_snapshot cbf4e90a-fea5-466d-8798-850225681d75: created successfully Aug 25 06:54:23 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d6406a1-22d5-4967-b0e6-d12cc56c770a" returned: 0 in 0.302s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "cinder-quobyte-4d6406a1-22d5-4967-b0e6-d12cc56c770a" released by "delete_volume" :: held 0.775s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Created reservations ['44f9e9d5-b982-4543-82a4-4571bf3f5f49', '2f9cfc8d-f3c8-4875-9fa2-46781aa9e5b3', 'f7338e38-0d25-4677-acfa-d87dbd8bfc59', '4b36d42f-ab2a-4545-bdf3-9f9a1a85c5c1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:23 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:23 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:24 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Deleted volume successfully. Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-438ad0c5-3deb-4949-8f40-0b91025aa343 tempest-VolumesImageMetadata-971366562 None] Lock "cinder-4d6406a1-22d5-4967-b0e6-d12cc56c770a-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot cbf4e90a-fea5-466d-8798-850225681d75: deleting Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot cbf4e90a-fea5-466d-8798-850225681d75: deleting {{(pid=94487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-ce55b5f8-209a-43e6-adcf-a5786c8a57fd" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ce55b5f8-209a-43e6-adcf-a5786c8a57fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Deleting offline snapshot ce55b5f8-209a-43e6-adcf-a5786c8a57fd of volume 290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] snapshot_file for this snap is: volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e08d9-874c-4386-8163-5bb32fa43721]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:24 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd Aug 25 06:54:24 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:25 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd" returned: 0 in 0.481s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290c15fc-c8df-461c-afd9-021bc4ddce3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a4c71-9136-4b0b-979e-9e850a80f277]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:25 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b Aug 25 06:54:25 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:25 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b" returned: 0 in 0.459s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:25 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd Aug 25 06:54:25 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:26 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:26 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd Aug 25 06:54:26 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (ecab09f9-3bcd-41fc-9df5-bbbfd8c0b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60dc175-59ad-4ab1-9b09-596d3fb90ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60dc175-59ad-4ab1-9b09-596d3fb90ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1752638711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd235b9-3e25-4bb6-a0c5-26be3452f321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:26Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:26 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19391091-3b55-4f1c-b083-cf7f96bc2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19391091-3b55-4f1c-b083-cf7f96bc2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3e972-42dd-4ea9-ba2d-8fe548643a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3e972-42dd-4ea9-ba2d-8fe548643a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd235b9-3e25-4bb6-a0c5-26be3452f321', 'volume_name': 'volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f29a494-c28a-495a-97d6-9d86adc440ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f29a494-c28a-495a-97d6-9d86adc440ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f15cc6-0cf5-4caf-be13-f3ea0744cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:26 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Volume 0fd235b9-3e25-4bb6-a0c5-26be3452f321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321', 'volume_size': 1} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1752638711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd235b9-3e25-4bb6-a0c5-26be3452f321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:26Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Creating volume 0fd235b9-3e25-4bb6-a0c5-26be3452f321 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:26 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b.ce55b5f8-209a-43e6-adcf-a5786c8a57fd" returned: 0 in 0.386s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:26 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 1073741824 Aug 25 06:54:26 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-ce55b5f8-209a-43e6-adcf-a5786c8a57fd" released by "_delete_snapshot" :: held 1.879s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" released by "delete_snapshot" :: held 1.910s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:26 devstack cinder-volume[94487]: WARNING cinder.quota [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1474467419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1474467419, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:26 devstack cinder-volume[94487]: WARNING cinder.quota [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1474467419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1474467419, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:26 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['cb6aaef5-4c3f-478c-a7fc-fac9423efa9f', 'a27ae1c2-7985-4cd5-88a8-9f4f98e08680', 'a4f2d5f2-6e3b-4d32-83f7-d5482816673c', '8e184708-44f3-4cf6-b114-4739966c5661'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3be8db9a-86fe-4856-a949-037b87b16859 tempest-GroupSnapshotsTest-1769840491 None] group_snapshot cbf4e90a-fea5-466d-8798-850225681d75: deleted successfully Aug 25 06:54:27 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 1073741824" returned: 0 in 0.716s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:27 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 Aug 25 06:54:27 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f24a6-fe86-492f-9433-95709aa8504e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:27 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321" returned: 0 in 0.453s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f15cc6-0cf5-4caf-be13-f3ea0744cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4f562f-f11a-46a7-9a70-814ec8e4c06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b Aug 25 06:54:27 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Volume volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 (0fd235b9-3e25-4bb6-a0c5-26be3452f321): created successfully Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4f562f-f11a-46a7-9a70-814ec8e4c06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (ecab09f9-3bcd-41fc-9df5-bbbfd8c0b26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Flow 'volume_create_manager' (a47e4e59-c12d-4d15-8f8d-52e2a5f81ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ed713c-60b6-4431-b15c-89c52ff7aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ce0ac569-fa8e-4df3-94eb-5307dda747b1 tempest-AttachVolumeTestJSON-271035856 None] Created volume successfully. Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ed713c-60b6-4431-b15c-89c52ff7aa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1663723346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade63a5-28af-486f-9f56-22a06cc3f534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='577c7a78833e4e8b9fd206f1ed1fa075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:28Z,use_quota=True,user_id='9cc9a643fd344274936e06f6821d6f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e03f93-91e2-4a41-9dc1-e8bcd387a6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e03f93-91e2-4a41-9dc1-e8bcd387a6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147f0a33-2b1d-46c3-91b6-56b375fa4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147f0a33-2b1d-46c3-91b6-56b375fa4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ade63a5-28af-486f-9f56-22a06cc3f534', 'volume_name': 'volume-4ade63a5-28af-486f-9f56-22a06cc3f534', 'volume_size': 2}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3227f34c-a89e-4454-8232-b1644b2e4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3227f34c-a89e-4454-8232-b1644b2e4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0083c296-1a26-4351-ba2c-cba12a116c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Volume 4ade63a5-28af-486f-9f56-22a06cc3f534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ade63a5-28af-486f-9f56-22a06cc3f534', 'volume_size': 2} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1663723346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade63a5-28af-486f-9f56-22a06cc3f534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='577c7a78833e4e8b9fd206f1ed1fa075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:28Z,use_quota=True,user_id='9cc9a643fd344274936e06f6821d6f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Creating volume 4ade63a5-28af-486f-9f56-22a06cc3f534 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:27 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 2147483648 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:27 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 2147483648 Aug 25 06:54:27 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:28 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b" returned: 0 in 0.474s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:28 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b Aug 25 06:54:28 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:28 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-290c15fc-c8df-461c-afd9-021bc4ddce3b" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Lock "cinder-quobyte-290c15fc-c8df-461c-afd9-021bc4ddce3b" released by "delete_volume" :: held 0.905s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['a1e5ac07-fd0c-48f8-af00-e8bc192ef0fd'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:28 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 2147483648" returned: 0 in 0.632s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94487]: WARNING cinder.quota [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1474467419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1474467419, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Created reservations ['c7093bc2-2dcf-463b-8595-c24bcec1abf4', '2cbeb119-5434-4051-82a7-f61c6c94db62', 'd5592c6b-56a1-4952-95e3-3a2bf6920ef7', '51f8f24b-7902-4891-8406-37cb326d91bb'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:28 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 Aug 25 06:54:28 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:28 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:28 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:28 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0083c296-1a26-4351-ba2c-cba12a116c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ade63a5-28af-486f-9f56-22a06cc3f534', 'volume_size': 2}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb289c2-703f-4f06-8f0c-a595a00ec840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Volume volume-4ade63a5-28af-486f-9f56-22a06cc3f534 (4ade63a5-28af-486f-9f56-22a06cc3f534): created successfully Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb289c2-703f-4f06-8f0c-a595a00ec840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Flow 'volume_create_manager' (a47e4e59-c12d-4d15-8f8d-52e2a5f81ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8a9942de-6a9e-4087-94a9-ad03b9529587 tempest-VolumesCloneNegativeTest-1694714471 None] Created volume successfully. Aug 25 06:54:29 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0b5c451d-3518-4457-88f6-24f709197aa0 tempest-GroupSnapshotsTest-1769840491 None] Delete group completed successfully. Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-6500e0b5-e156-48a7-a676-ef3eb410e7d0 req-79e80f82-c8e7-4dee-8508-98b84474c550 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-6500e0b5-e156-48a7-a676-ef3eb410e7d0 req-79e80f82-c8e7-4dee-8508-98b84474c550 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-6500e0b5-e156-48a7-a676-ef3eb410e7d0 req-79e80f82-c8e7-4dee-8508-98b84474c550 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-6500e0b5-e156-48a7-a676-ef3eb410e7d0 req-79e80f82-c8e7-4dee-8508-98b84474c550 tempest-AttachVolumeTestJSON-271035856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78e69fa3-0ef1-4e3d-9c7a-10773d61b79e', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:54:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-6500e0b5-e156-48a7-a676-ef3eb410e7d0 req-79e80f82-c8e7-4dee-8508-98b84474c550 tempest-AttachVolumeTestJSON-271035856 None] attachment_update completed successfully. Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Acquiring lock "cinder-4ade63a5-28af-486f-9f56-22a06cc3f534-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "cinder-4ade63a5-28af-486f-9f56-22a06cc3f534-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Acquiring lock "cinder-quobyte-4ade63a5-28af-486f-9f56-22a06cc3f534" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "cinder-quobyte-4ade63a5-28af-486f-9f56-22a06cc3f534" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b20db8-0cd8-4515-8dec-146c60c3dec9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:30 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 Aug 25 06:54:30 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:30 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534" returned: 0 in 0.537s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:30 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534 Aug 25 06:54:30 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:30 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4ade63a5-28af-486f-9f56-22a06cc3f534" returned: 0 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "cinder-quobyte-4ade63a5-28af-486f-9f56-22a06cc3f534" released by "delete_volume" :: held 0.926s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=159,cinder:SELECT=153,cinder:INSERT=40,cinder:DELETE=4 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=162,cinder:INSERT=45,cinder:UPDATE=157,cinder:DELETE=9 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Created reservations ['1e9c7017-4823-402a-8cd0-0500ae952baf', '92419233-8d0b-4562-804d-305a2bc3e136', '2a4e00c9-f12f-41d1-9116-10a1a29606f5', '8455eca7-e860-4385-a44b-2e8e91813d49'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:31 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:31 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:31 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Deleted volume successfully. Aug 25 06:54:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f8a9538a-76de-49ae-9342-b33d2832694b tempest-VolumesCloneNegativeTest-1694714471 None] Lock "cinder-4ade63a5-28af-486f-9f56-22a06cc3f534-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (5ee77b99-267b-4ea4-ad18-398a04c169ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f89934-e412-49f1-92d7-1bac36315e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f89934-e412-49f1-92d7-1bac36315e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1821458986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286cb821-ecf8-4fb8-b203-f8e873db2102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:33Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9910c8e3-6a60-409d-92be-fa54c94ae1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9910c8e3-6a60-409d-92be-fa54c94ae1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1813f-1ef9-4133-a533-e64c7343dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1813f-1ef9-4133-a533-e64c7343dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286cb821-ecf8-4fb8-b203-f8e873db2102', 'volume_name': 'volume-286cb821-ecf8-4fb8-b203-f8e873db2102', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42927bdd-7726-444b-8ce0-b32786f437d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42927bdd-7726-444b-8ce0-b32786f437d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcec721-2f67-42b6-ba3b-5eb6f229d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Volume 286cb821-ecf8-4fb8-b203-f8e873db2102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286cb821-ecf8-4fb8-b203-f8e873db2102', 'volume_size': 1} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1821458986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286cb821-ecf8-4fb8-b203-f8e873db2102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6750cc41494915be854026cd214e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:33Z,use_quota=True,user_id='31c6a9cfcf1546deb6c6a8f906f56c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Creating volume 286cb821-ecf8-4fb8-b203-f8e873db2102 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:32 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:32 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 1073741824 Aug 25 06:54:32 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:33 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 1073741824" returned: 0 in 0.607s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:33 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 Aug 25 06:54:33 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:33 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102" returned: 0 in 0.359s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcec721-2f67-42b6-ba3b-5eb6f229d914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286cb821-ecf8-4fb8-b203-f8e873db2102', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78341b34-ec52-40b9-b745-3155857ec481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Volume volume-286cb821-ecf8-4fb8-b203-f8e873db2102 (286cb821-ecf8-4fb8-b203-f8e873db2102): created successfully Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78341b34-ec52-40b9-b745-3155857ec481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Flow 'volume_create_manager' (5ee77b99-267b-4ea4-ad18-398a04c169ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-680e3df1-eb18-4128-a190-45acf873b7a8 tempest-AttachVolumeTestJSON-271035856 None] Created volume successfully. Aug 25 06:54:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3107e455-db66-4f4c-88de-b911f03a6bf9 req-699bfbcf-77b4-49d2-8adb-034bca58d50d tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3107e455-db66-4f4c-88de-b911f03a6bf9 req-699bfbcf-77b4-49d2-8adb-034bca58d50d tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3107e455-db66-4f4c-88de-b911f03a6bf9 req-699bfbcf-77b4-49d2-8adb-034bca58d50d tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-3107e455-db66-4f4c-88de-b911f03a6bf9 req-699bfbcf-77b4-49d2-8adb-034bca58d50d tempest-AttachVolumeTestJSON-271035856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-286cb821-ecf8-4fb8-b203-f8e873db2102', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4777d546-7532-44b0-ae52-9f882fd84105', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:54:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-3107e455-db66-4f4c-88de-b911f03a6bf9 req-699bfbcf-77b4-49d2-8adb-034bca58d50d tempest-AttachVolumeTestJSON-271035856 None] attachment_update completed successfully. Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Flow 'volume_create_manager' (39ac13bc-18da-421b-87f7-3a71b2a6e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f626e466-83bb-42c1-9e2d-f8c4ae2b4240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f626e466-83bb-42c1-9e2d-f8c4ae2b4240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-105122549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9334993c-0737-4a8e-a2e3-e36388e0f1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe57c6a54e4a4da8c4c0f8ac9d73e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:37Z,use_quota=True,user_id='17311f7935d64b6d8720760a08b8352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9920ef7a-3e13-4bef-bb1c-93b72ac77bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9920ef7a-3e13-4bef-bb1c-93b72ac77bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96bc6f6-46d8-498f-864b-0adc99ff351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96bc6f6-46d8-498f-864b-0adc99ff351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9334993c-0737-4a8e-a2e3-e36388e0f1db', 'volume_name': 'volume-9334993c-0737-4a8e-a2e3-e36388e0f1db', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96963be3-3406-4659-aecb-6b9ddddb8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96963be3-3406-4659-aecb-6b9ddddb8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac713a4-f0c7-4052-b11a-c1591abe1f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Volume 9334993c-0737-4a8e-a2e3-e36388e0f1db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9334993c-0737-4a8e-a2e3-e36388e0f1db', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:54:37 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Trying to clone 9334993c-0737-4a8e-a2e3-e36388e0f1db from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:54:38 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:54:38 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:54:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b433e2c-e6fb-48b1-ac7f-0d60da57c111]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:38 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD Aug 25 06:54:38 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:39 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a is fetched for user 17311f7935d64b6d8720760a08b8352c. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac285b2-1c79-48f3-a87e-b1951b9c52ba]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:39 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD Aug 25 06:54:39 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-f988d9fc-a04a-46e2-a970-0064289c50cb req-effa69b3-cb88-4256-acc7-a4ed62d81b92 tempest-AttachVolumeTestJSON-271035856 None] Terminate volume connection completed successfully. Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-f988d9fc-a04a-46e2-a970-0064289c50cb req-effa69b3-cb88-4256-acc7-a4ed62d81b92 tempest-AttachVolumeTestJSON-271035856 None] Deleting attachment 78e69fa3-0ef1-4e3d-9c7a-10773d61b79e. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:54:39 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-105122549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9334993c-0737-4a8e-a2e3-e36388e0f1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe57c6a54e4a4da8c4c0f8ac9d73e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:37Z,use_quota=True,user_id='17311f7935d64b6d8720760a08b8352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Creating volume 9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:39 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:39 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1073741824 Aug 25 06:54:39 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:40 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1073741824" returned: 0 in 0.655s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:40 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db Aug 25 06:54:40 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:40 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Attempting download of 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 9334993c-0737-4a8e-a2e3-e36388e0f1db. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad9432-f351-40a0-a5df-8478ccbb6650]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg Aug 25 06:54:41 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-665f558f-5481-4692-a256-ff22fedbf0ef req-291a1cbf-86c4-4b3b-9521-418bcf4dcac3 tempest-AttachVolumeTestJSON-271035856 None] Terminate volume connection completed successfully. Aug 25 06:54:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-665f558f-5481-4692-a256-ff22fedbf0ef req-291a1cbf-86c4-4b3b-9521-418bcf4dcac3 tempest-AttachVolumeTestJSON-271035856 None] Deleting attachment 4777d546-7532-44b0-ae52-9f882fd84105. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:54:41 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg Aug 25 06:54:41 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:42 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg" returned: 1 in 0.666s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_d8gxs5gg' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d74e1bc-ae29-40bf-85fb-f8913565db70]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD Aug 25 06:54:42 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:42 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:54:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db Aug 25 06:54:42 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:45 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db" returned: 0 in 3.096s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:45 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_2m37n91tdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:54:45 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Converted 112.00 MB image at 36.15 MB/s Aug 25 06:54:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:45 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1G Aug 25 06:54:45 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:46 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 1G" returned: 0 in 0.459s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Downloaded image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 9334993c-0737-4a8e-a2e3-e36388e0f1db successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a for user 17311f7935d64b6d8720760a08b8352c is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Marking volume 9334993c-0737-4a8e-a2e3-e36388e0f1db as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Copying metadata from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a to 9334993c-0737-4a8e-a2e3-e36388e0f1db. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Creating volume glance metadata for volume 9334993c-0737-4a8e-a2e3-e36388e0f1db backed by image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac713a4-f0c7-4052-b11a-c1591abe1f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9334993c-0737-4a8e-a2e3-e36388e0f1db', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985850f5-959f-4dcb-94c2-258e80c78c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:46 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Volume volume-9334993c-0737-4a8e-a2e3-e36388e0f1db (9334993c-0737-4a8e-a2e3-e36388e0f1db): created successfully Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985850f5-959f-4dcb-94c2-258e80c78c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Flow 'volume_create_manager' (39ac13bc-18da-421b-87f7-3a71b2a6e514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-84ab5805-7094-4591-b20f-1e3f16843010 tempest-VolumesExtendTest-761372587 None] Created volume successfully. Aug 25 06:54:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5aa8e563-644b-4417-b335-d19809268dfa tempest-GroupsV314Test-1652815966 None] Group tempest-GroupsV314Test-Group-752913670: creating Aug 25 06:54:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5aa8e563-644b-4417-b335-d19809268dfa tempest-GroupsV314Test-1652815966 None] Group tempest-GroupsV314Test-Group-752913670: created successfully Aug 25 06:54:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5aa8e563-644b-4417-b335-d19809268dfa tempest-GroupsV314Test-1652815966 None] Create group completed successfully. Aug 25 06:54:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:47 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b9b59-2553-4c22-9685-e76ddb91fd9e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:47 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db Aug 25 06:54:47 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-286cb821-ecf8-4fb8-b203-f8e873db2102-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-286cb821-ecf8-4fb8-b203-f8e873db2102-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-quobyte-286cb821-ecf8-4fb8-b203-f8e873db2102" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:48 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-286cb821-ecf8-4fb8-b203-f8e873db2102" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db" returned: 0 in 0.630s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 2G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[95245401-27f5-464b-8749-677503ca383b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db 2G" returned: 0 in 0.220s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.893s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:48 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 Aug 25 06:54:48 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-28fef7a2-011e-40af-a5e3-e2f293452692 tempest-VolumesExtendTest-761372587 None] Extend volume completed successfully. Aug 25 06:54:49 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102" returned: 0 in 0.830s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102 Aug 25 06:54:49 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Flow 'volume_create_manager' (35c6a53f-4857-4cf4-bcf0-30e39421a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a31f1-c5c4-4be8-9887-fbe13b249dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-9334993c-0737-4a8e-a2e3-e36388e0f1db-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a31f1-c5c4-4be8-9887-fbe13b249dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489060757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=310ab38f-6f8c-4aca-87c0-56d332cf3fff,host='devstack@QuobyteHD#QuobyteHD',id=89fc4d9a-5b33-44b3-b069-237171bfa8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f21b75f9874371bf371f1d32f0c793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:49Z,use_quota=True,user_id='b271bc6ec0484374a1922f1c8449ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2994db4-de4f-4372-8334-e73fd91c644f),volume_type_id=c2994db4-de4f-4372-8334-e73fd91c644f)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032db6e9-1e94-45e9-a7d6-65c8cab6608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032db6e9-1e94-45e9-a7d6-65c8cab6608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5b3af3-0e07-436a-b9f6-d07195ef4fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5b3af3-0e07-436a-b9f6-d07195ef4fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fc4d9a-5b33-44b3-b069-237171bfa8c7', 'volume_name': 'volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686a5a2d-02d1-42c2-be17-4b2cdd73db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686a5a2d-02d1-42c2-be17-4b2cdd73db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9518980-2d94-4f9a-81a6-2051eb98520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Volume 89fc4d9a-5b33-44b3-b069-237171bfa8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7', 'volume_size': 1} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=310ab38f-6f8c-4aca-87c0-56d332cf3fff,created_at=2026-08-25T04:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489060757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=310ab38f-6f8c-4aca-87c0-56d332cf3fff,host='devstack@QuobyteHD#QuobyteHD',id=89fc4d9a-5b33-44b3-b069-237171bfa8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f21b75f9874371bf371f1d32f0c793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:49Z,use_quota=True,user_id='b271bc6ec0484374a1922f1c8449ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2994db4-de4f-4372-8334-e73fd91c644f),volume_type_id=c2994db4-de4f-4372-8334-e73fd91c644f)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Creating volume 89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:49 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "cinder-9334993c-0737-4a8e-a2e3-e36388e0f1db-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:49 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 1073741824 Aug 25 06:54:49 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-quobyte-9334993c-0737-4a8e-a2e3-e36388e0f1db" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:49 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-9334993c-0737-4a8e-a2e3-e36388e0f1db" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-286cb821-ecf8-4fb8-b203-f8e873db2102" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af33b16-0bf9-4c58-bc66-81f3b7558516]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-286cb821-ecf8-4fb8-b203-f8e873db2102" released by "delete_volume" :: held 1.349s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Created reservations ['c70cd927-04b6-4741-9c8d-ac881d5d8070', 'd82f955b-f631-4be0-8778-a64ee967c479', 'df35e696-9840-4365-8dac-975768b11b9d', 'cf8d5941-dc5b-402c-8722-eb6246d7f2e2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:49 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db Aug 25 06:54:49 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:49 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 1073741824" returned: 0 in 0.923s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db" returned: 0 in 0.812s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:50 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db Aug 25 06:54:50 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:54:50 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.659s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Deleted volume successfully. Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cabca61e-5fef-47a6-9d2a-7a3424e88bda tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-286cb821-ecf8-4fb8-b203-f8e873db2102-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:50 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9334993c-0737-4a8e-a2e3-e36388e0f1db" returned: 0 in 0.509s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-9334993c-0737-4a8e-a2e3-e36388e0f1db" released by "delete_volume" :: held 1.372s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:50 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.501s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9518980-2d94-4f9a-81a6-2051eb98520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e5388-712c-4a1a-8507-06dbe4b5045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Volume volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 (89fc4d9a-5b33-44b3-b069-237171bfa8c7): created successfully Aug 25 06:54:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e5388-712c-4a1a-8507-06dbe4b5045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Flow 'volume_create_manager' (35c6a53f-4857-4cf4-bcf0-30e39421a56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Created reservations ['eb7ebb01-c3bb-4fbb-98f8-b6cfff644b26', 'c2a1ccd3-6a88-4211-9faa-06e03520c8d2', '63ea7e21-cb39-4186-9b45-eb0735648bbe', '1b31b081-688c-4aa2-b232-337310534ae3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1e07e905-d333-47f3-a9ae-04c350184545 tempest-GroupsV314Test-1652815966 None] Created volume successfully. Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-0fd235b9-3e25-4bb6-a0c5-26be3452f321-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-0fd235b9-3e25-4bb6-a0c5-26be3452f321-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-quobyte-0fd235b9-3e25-4bb6-a0c5-26be3452f321" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:51 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-0fd235b9-3e25-4bb6-a0c5-26be3452f321" acquired by "delete_volume" :: waited 0.058s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:51 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[16643640-3175-47d3-b997-1120d07a1452]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:51 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 Aug 25 06:54:51 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:51 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Deleted volume successfully. Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18fe7ad3-ffed-4219-b81d-00d66107945f tempest-VolumesExtendTest-761372587 None] Lock "cinder-9334993c-0737-4a8e-a2e3-e36388e0f1db-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:51 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321" returned: 0 in 0.629s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:51 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321 Aug 25 06:54:51 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:52 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fd235b9-3e25-4bb6-a0c5-26be3452f321" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-0fd235b9-3e25-4bb6-a0c5-26be3452f321" released by "delete_volume" :: held 1.057s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Created reservations ['45697176-60dc-4359-a227-ea5a58cd10c2', '74461960-195c-4654-a017-fd2fbd149746', 'ffd2aa13-461c-428a-8be0-0f386780a367', '18b98ff2-aa0a-4fbb-9d02-ca5f9a13bf86'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Flow 'volume_create_manager' (d85c990a-b0e7-439f-80a4-f1e82f00f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d5b9d-6fcd-4416-97d4-c18aab36320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d5b9d-6fcd-4416-97d4-c18aab36320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1983263850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79faa7d9-8cde-4c54-8d68-c6d3fab1e54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe57c6a54e4a4da8c4c0f8ac9d73e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:52Z,use_quota=True,user_id='17311f7935d64b6d8720760a08b8352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e559ae-3ac0-4afc-a2b2-9fa0a947c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e559ae-3ac0-4afc-a2b2-9fa0a947c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e20bad4-8960-4c87-b8ee-73777df00a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e20bad4-8960-4c87-b8ee-73777df00a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79faa7d9-8cde-4c54-8d68-c6d3fab1e54d', 'volume_name': 'volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be54645-842d-4bf6-b1ef-86614feb4df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be54645-842d-4bf6-b1ef-86614feb4df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57de68d3-99e3-4d73-9718-da7f7ac3cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Volume 79faa7d9-8cde-4c54-8d68-c6d3fab1e54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d', 'volume_size': 1} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1983263850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79faa7d9-8cde-4c54-8d68-c6d3fab1e54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe57c6a54e4a4da8c4c0f8ac9d73e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:52Z,use_quota=True,user_id='17311f7935d64b6d8720760a08b8352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Creating volume 79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:52 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d 1073741824 Aug 25 06:54:52 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:52 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:52 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:53 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Deleted volume successfully. Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fb5e3609-6b36-4d09-ac04-a2bcf3c35d98 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-0fd235b9-3e25-4bb6-a0c5-26be3452f321-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:53 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d 1073741824" returned: 0 in 0.834s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:53 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:54:53 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-39554924-7d5f-4387-8e69-359eb1b991c1-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-39554924-7d5f-4387-8e69-359eb1b991c1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:53 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.510s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.079s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:53 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Cloning volume 89fc4d9a-5b33-44b3-b069-237171bfa8c7 to volume efeb0be9-15a2-4fa0-84c0-5dbf33d195fe Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "cinder-quobyte-39554924-7d5f-4387-8e69-359eb1b991c1" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57de68d3-99e3-4d73-9718-da7f7ac3cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faadd8-bb7c-4acb-8f55-4294e8f65076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-39554924-7d5f-4387-8e69-359eb1b991c1" acquired by "delete_volume" :: waited 0.052s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Volume volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d (79faa7d9-8cde-4c54-8d68-c6d3fab1e54d): created successfully Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faadd8-bb7c-4acb-8f55-4294e8f65076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Flow 'volume_create_manager' (d85c990a-b0e7-439f-80a4-f1e82f00f69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b39710-babe-400e-8612-97b4235cb26c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-59f31143-86c9-4237-8ab9-1e98c4e8e28c tempest-VolumesExtendTest-761372587 None] Created volume successfully. Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Creating offline snapshot e3114ad3-2a29-40ad-974b-1428181d29f8 of volume 89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e235ea9f-1da3-4d14-bf74-0cf7300d42c0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:54 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:54:54 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:54 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 Aug 25 06:54:54 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:54 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.735s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:55 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:55 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 1G Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1" returned: 0 in 0.866s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:55 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:55 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1 Aug 25 06:54:55 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:55 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-39554924-7d5f-4387-8e69-359eb1b991c1" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-quobyte-39554924-7d5f-4387-8e69-359eb1b991c1" released by "delete_volume" :: held 1.356s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Created reservations ['87ddb651-70b2-4307-a153-ae579521fab2', 'b7136f4d-9de9-4785-b319-28a46692c014', '66458b14-572c-48ff-9d0b-f1a0b4dd0fef', 'c91c8648-8cd0-48b3-9d41-d9d268473d58'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:55 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:54:55 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:55 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 1G" returned: 0 in 0.715s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:55 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:54:55 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.567s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Deleted volume successfully. Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-859c82de-fcce-4c4a-907f-fbb3dd19d0d5 tempest-AttachVolumeTestJSON-271035856 None] Lock "cinder-39554924-7d5f-4387-8e69-359eb1b991c1-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:56 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.658s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:54:56 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.303s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info Aug 25 06:54:56 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:57 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info" returned: 0 in 0.929s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:57 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:57 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info Aug 25 06:54:57 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:58 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.info" returned: 0 in 0.608s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Acquiring lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] snapshot: e3114ad3-2a29-40ad-974b-1428181d29f8, volume: efeb0be9-15a2-4fa0-84c0-5dbf33d195fe, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7342929a-de6b-46ff-b406-4f114d9eea18]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:58 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:54:58 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:59 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.697s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d128a-9819-4e71-960c-43232ea75e7d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:59 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:54:59 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:59 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.721s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:54:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:59 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe Aug 25 06:54:59 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:00 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:00 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:01 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.998s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:55:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:55:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:55:06 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:INSERT=15,cinder:UPDATE=65,cinder:SELECT=55,cinder:DELETE=3 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:55:06 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=58,cinder:INSERT=24,cinder:UPDATE=54,cinder:DELETE=6 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:55:08 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" returned: 0 in 8.768s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:08 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:55:08 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Converted 1024.00 MB image at 116.75 MB/s Aug 25 06:55:08 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:55:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:08 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe Aug 25 06:55:08 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:09 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" released by "_copy_volume_from_snapshot" :: held 10.679s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Acquiring lock "cinder-quobyte-e3114ad3-2a29-40ad-974b-1428181d29f8" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-e3114ad3-2a29-40ad-974b-1428181d29f8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Deleting offline snapshot e3114ad3-2a29-40ad-974b-1428181d29f8 of volume 89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] snapshot_file for this snap is: volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[317999c9-ffb4-4f40-b365-a0cb368e552c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:09 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:55:09 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:09 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.732s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdc5c0a-6b39-40a2-b3fa-8682266707e6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:10 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:55:10 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:10 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.754s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:10 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:55:10 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.634s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:11 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8 Aug 25 06:55:11 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7.e3114ad3-2a29-40ad-974b-1428181d29f8" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-e3114ad3-2a29-40ad-974b-1428181d29f8" released by "_delete_snapshot" :: held 2.594s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.822s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.645s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Creating offline snapshot 395b0e6d-6ba8-4453-9f25-8c103cd985f4 of volume 79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[45809252-6db5-4513-8590-2465b4ab0d76]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-180182a7-0cd7-4406-8738-4c117a93d69d tempest-GroupsV314Test-1652815966 None] Create group from source-group-310ab38f-6f8c-4aca-87c0-56d332cf3fff completed successfully. Aug 25 06:55:11 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:55:11 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:12 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.510s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:12 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 1G Aug 25 06:55:12 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:13 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 1G" returned: 0 in 0.730s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:13 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 Aug 25 06:55:13 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:13 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4" returned: 0 in 0.496s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:13 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 is being set with open permissions: ugo+rw Aug 25 06:55:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:13 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 Aug 25 06:55:13 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:13 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4" returned: 0 in 0.335s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Acquiring lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:14 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info Aug 25 06:55:14 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9160de4-49a3-45dc-b03f-e31c275f09a1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe Aug 25 06:55:14 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info" returned: 0 in 0.485s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:14 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info is being set with open permissions: ugo+rw Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info Aug 25 06:55:14 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" returned: 0 in 0.685s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe Aug 25 06:55:14 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.info" returned: 0 in 0.474s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4d7a9f6c-5bf2-47e3-9989-6d554aa96082 tempest-VolumesExtendTest-761372587 None] Create snapshot completed successfully Aug 25 06:55:15 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" returned: 0 in 0.391s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-efeb0be9-15a2-4fa0-84c0-5dbf33d195fe" released by "delete_volume" :: held 1.170s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Created reservations ['fd16940c-aeb5-47d7-8f7f-cb29c47d617b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:15 devstack cinder-volume[94487]: WARNING cinder.quota [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2101294229 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2101294229, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:15 devstack cinder-volume[94487]: WARNING cinder.quota [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2101294229 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2101294229, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Created reservations ['acfebddf-1fa3-4d3a-b3fd-fb8e5b47e9a4', 'b32462d0-a8b9-4c28-9d2b-ce24d5324909', '72c3cc20-1899-4aba-a12b-7c5c42eafe15', '5dfa12a9-7c07-4f26-8264-7e9c644ae8bd'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Flow 'volume_create_manager' (2a69043b-dcf4-40ac-bf35-85f4ba24194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af7cbb9-a0da-4781-a7f8-b4630f377329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af7cbb9-a0da-4781-a7f8-b4630f377329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-232349785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4787f17-7d04-4d7c-a461-e979aa229cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689fcd3390594cdca41b4c30b001777f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:16Z,use_quota=True,user_id='99e4cecb804b4ac8823a3d83f776b7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4b9e6-50c3-4a7c-8cd2-2a33c9db38a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4b9e6-50c3-4a7c-8cd2-2a33c9db38a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e21a3d-235b-4caa-b25b-cbd9100ec0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e21a3d-235b-4caa-b25b-cbd9100ec0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4787f17-7d04-4d7c-a461-e979aa229cb5', 'volume_name': 'volume-c4787f17-7d04-4d7c-a461-e979aa229cb5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7752d60e-36e6-4cb7-9c37-598b6607a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7752d60e-36e6-4cb7-9c37-598b6607a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286573ce-d5e2-4f03-bac8-930c17958572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:15 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Volume c4787f17-7d04-4d7c-a461-e979aa229cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4787f17-7d04-4d7c-a461-e979aa229cb5', 'volume_size': 1} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-232349785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4787f17-7d04-4d7c-a461-e979aa229cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689fcd3390594cdca41b4c30b001777f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:16Z,use_quota=True,user_id='99e4cecb804b4ac8823a3d83f776b7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Creating volume c4787f17-7d04-4d7c-a461-e979aa229cb5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:15 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:15 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 1073741824 Aug 25 06:55:15 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:15 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:15 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:16 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.426s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4e0ff1fb-b0ac-4b45-a770-45009d470491 tempest-GroupsV314Test-1652815966 None] Delete group completed successfully. Aug 25 06:55:16 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 1073741824" returned: 0 in 0.634s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:16 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 Aug 25 06:55:16 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:16 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.623s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286573ce-d5e2-4f03-bac8-930c17958572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4787f17-7d04-4d7c-a461-e979aa229cb5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d412d4-6169-45f3-8443-71320bb7d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b170862-96a6-4f7d-8736-f93dab2f4849]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Volume volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 (c4787f17-7d04-4d7c-a461-e979aa229cb5): created successfully Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d412d4-6169-45f3-8443-71320bb7d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Flow 'volume_create_manager' (2a69043b-dcf4-40ac-bf35-85f4ba24194a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e18aab68-4aa5-4def-bed1-3e2c38a51c9e tempest-ServerRescueNegativeTestJSON-1857641490 None] Created volume successfully. Aug 25 06:55:17 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:55:17 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Acquiring lock "cinder-quobyte-89fc4d9a-5b33-44b3-b069-237171bfa8c7" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-89fc4d9a-5b33-44b3-b069-237171bfa8c7" acquired by "delete_volume" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278e8f9-03d3-4cad-9001-b99781fab007]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:55:17 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:17 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.687s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 2G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.494s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 2G" returned: 0 in 0.164s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.905s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:17 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7 Aug 25 06:55:17 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f6e129f8-df12-42b1-bbac-97a82b2ab86b tempest-VolumesExtendTest-761372587 None] Extend volume completed successfully. Aug 25 06:55:18 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-89fc4d9a-5b33-44b3-b069-237171bfa8c7" returned: 0 in 0.469s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Lock "cinder-quobyte-89fc4d9a-5b33-44b3-b069-237171bfa8c7" released by "delete_volume" :: held 1.066s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Created reservations ['01da782f-e4a9-49c9-a7b9-82f4353ff9b4'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Created reservations ['5109fe33-e0f0-4b46-9070-4e7d1c192299', 'c3939972-6f3c-4033-b674-3f8847d8e346', '2589b0e2-ccfe-4f39-b45b-1c35057f41ac', '863452c4-40dc-4352-bb10-b8e9eb7250c2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-395b0e6d-6ba8-4453-9f25-8c103cd985f4-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:18 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:18 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-395b0e6d-6ba8-4453-9f25-8c103cd985f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-quobyte-395b0e6d-6ba8-4453-9f25-8c103cd985f4" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-395b0e6d-6ba8-4453-9f25-8c103cd985f4" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Deleting offline snapshot 395b0e6d-6ba8-4453-9f25-8c103cd985f4 of volume 79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] snapshot_file for this snap is: volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f3fd4-5f0c-49a9-8cce-8e58e2e917eb]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:19 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 Aug 25 06:55:19 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:19 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.490s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-11c06d96-400c-4eaf-8201-616116c4ad47 tempest-GroupsV314Test-1652815966 None] Delete group completed successfully. Aug 25 06:55:19 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4" returned: 0 in 0.640s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba9cae-a851-42d8-a965-0d56c2778c51]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:19 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:55:19 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:20 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.818s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:20 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 Aug 25 06:55:20 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:21 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4" returned: 0 in 0.850s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:21 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4 Aug 25 06:55:21 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:21 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d.395b0e6d-6ba8-4453-9f25-8c103cd985f4" returned: 0 in 0.517s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-395b0e6d-6ba8-4453-9f25-8c103cd985f4" released by "_delete_snapshot" :: held 2.989s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" released by "delete_snapshot" :: held 3.067s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:22 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Created reservations ['d9e40c09-d624-470e-affc-0fa07d77b891', '6b714b1e-a2da-4f83-a86b-992f6663ec83', '5b5cc8a8-c3aa-45b8-9706-0674daa23eab', '83d6a262-4df3-4668-9115-8d3996133042'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Delete snapshot completed successfully. Aug 25 06:55:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a1fe016a-404c-4eb0-bf4a-7808feb4bf8a tempest-VolumesExtendTest-761372587 None] Lock "cinder-395b0e6d-6ba8-4453-9f25-8c103cd985f4-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "cinder-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Acquiring lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68a955-16f2-4dba-ab9c-912da500b8aa]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:23 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:55:23 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:24 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.523s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:24 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d Aug 25 06:55:24 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:24 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" returned: 0 in 0.681s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "cinder-quobyte-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d" released by "delete_volume" :: held 1.335s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Created reservations ['e417337f-e2aa-490c-9b0d-d53c4a920a08', 'dbbb8bb2-580d-4f60-86f3-cd463f9ea65c', '8ca18009-6f58-4f2e-9fe1-f92d794f0b25', '483a08dc-f8a2-48a1-9ff9-7137701c07e0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:25 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:25 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:25 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.518s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Deleted volume successfully. Aug 25 06:55:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2c6753f7-b7ea-448d-958b-4d942305d9be tempest-VolumesExtendTest-761372587 None] Lock "cinder-79faa7d9-8cde-4c54-8d68-c6d3fab1e54d-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Flow 'volume_create_manager' (10725cf3-d0ce-4bb9-ac50-4372003d2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adcd4ae-723a-4e9b-8dae-01d49dd97089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adcd4ae-723a-4e9b-8dae-01d49dd97089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-431764563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33492a-51ff-499c-bf4a-f6635e5f3e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6171791b18e949548246199a11bdf3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:31Z,use_quota=True,user_id='53c81a7c2d8c48c3974582026d7840d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4921378-4b9e-448a-bf1d-ab75d1483c94),volume_type_id=e4921378-4b9e-448a-bf1d-ab75d1483c94)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b027171-fdec-472b-b85b-d24eaba7d6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b027171-fdec-472b-b85b-d24eaba7d6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda8aae7-8e5a-4b64-9c65-51dadab54238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda8aae7-8e5a-4b64-9c65-51dadab54238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da33492a-51ff-499c-bf4a-f6635e5f3e2a', 'volume_name': 'volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6617e969-a6ba-4a5f-87fa-0ca43ca25618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6617e969-a6ba-4a5f-87fa-0ca43ca25618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b34b269-3eef-4f09-9635-9922d82cd85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:31 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Volume da33492a-51ff-499c-bf4a-f6635e5f3e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a', 'volume_size': 1} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-431764563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33492a-51ff-499c-bf4a-f6635e5f3e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6171791b18e949548246199a11bdf3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:31Z,use_quota=True,user_id='53c81a7c2d8c48c3974582026d7840d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4921378-4b9e-448a-bf1d-ab75d1483c94),volume_type_id=e4921378-4b9e-448a-bf1d-ab75d1483c94)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Creating volume da33492a-51ff-499c-bf4a-f6635e5f3e2a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:31 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:55:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:31 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a 1073741824 Aug 25 06:55:31 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:32 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a 1073741824" returned: 0 in 1.017s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:32 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a Aug 25 06:55:32 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:32 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a" returned: 0 in 0.379s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b34b269-3eef-4f09-9635-9922d82cd85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07bdbe3-fff1-4075-8d92-00ff9b39ccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Volume volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a (da33492a-51ff-499c-bf4a-f6635e5f3e2a): created successfully Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07bdbe3-fff1-4075-8d92-00ff9b39ccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Flow 'volume_create_manager' (10725cf3-d0ce-4bb9-ac50-4372003d2dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f2003659-bf7f-474e-a16c-a821df05a452 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Created volume successfully. Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (18f4c23f-7b37-436f-b5c1-3b1ee7e30763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801c852a-30ff-488b-8ac9-3f2aeabce0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801c852a-30ff-488b-8ac9-3f2aeabce0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1507566010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f835cb0-71c7-4801-a394-281d6aec909a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:33Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd3115a-4125-4e94-ae46-d1db06a398bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd3115a-4125-4e94-ae46-d1db06a398bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14ea156-7f10-4d6d-a3ba-11a4b8f80477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14ea156-7f10-4d6d-a3ba-11a4b8f80477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f835cb0-71c7-4801-a394-281d6aec909a', 'volume_name': 'volume-2f835cb0-71c7-4801-a394-281d6aec909a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34b680a-4cc0-41c7-a529-684a439962d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34b680a-4cc0-41c7-a529-684a439962d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59ce9c4-1b6e-4a0a-8406-a3f6102c0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Volume 2f835cb0-71c7-4801-a394-281d6aec909a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f835cb0-71c7-4801-a394-281d6aec909a', 'volume_size': 1} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1507566010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f835cb0-71c7-4801-a394-281d6aec909a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:33Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Creating volume 2f835cb0-71c7-4801-a394-281d6aec909a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:33 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:33 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a 1073741824 Aug 25 06:55:33 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:33 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:33 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:34 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.578s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-415ae4ec-a8cf-4632-902a-50d17e15e51f tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Retype volume completed successfully. Aug 25 06:55:34 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a 1073741824" returned: 0 in 0.834s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:34 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a Aug 25 06:55:34 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:34 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a" returned: 0 in 0.537s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59ce9c4-1b6e-4a0a-8406-a3f6102c0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f835cb0-71c7-4801-a394-281d6aec909a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce352c9b-9339-4add-8bd9-259753c47c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:34 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Volume volume-2f835cb0-71c7-4801-a394-281d6aec909a (2f835cb0-71c7-4801-a394-281d6aec909a): created successfully Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce352c9b-9339-4add-8bd9-259753c47c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (18f4c23f-7b37-436f-b5c1-3b1ee7e30763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-78aca7cd-7674-4440-8365-e4e2e2987f1d tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "cinder-da33492a-51ff-499c-bf4a-f6635e5f3e2a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "cinder-da33492a-51ff-499c-bf4a-f6635e5f3e2a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "cinder-quobyte-da33492a-51ff-499c-bf4a-f6635e5f3e2a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "cinder-quobyte-da33492a-51ff-499c-bf4a-f6635e5f3e2a" acquired by "delete_volume" :: waited 0.052s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4e76a6-549e-4915-b60a-9e8c76d93afd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:35 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a Aug 25 06:55:35 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:36 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a" returned: 0 in 0.751s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:36 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a Aug 25 06:55:36 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (60b04d53-853a-450f-a4d9-0dd99cc9bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f5174f-0426-4541-860d-85a3571cf09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f5174f-0426-4541-860d-85a3571cf09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1728207465',display_name='tempest-VolumesGetTest-Volume-2090307297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fda88c6-94c6-4909-b211-57d7def6bf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:37Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2858fe45-cb66-45d9-aa81-a8c18f19bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2858fe45-cb66-45d9-aa81-a8c18f19bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68465e63-3955-46fe-9770-c253490309b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68465e63-3955-46fe-9770-c253490309b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fda88c6-94c6-4909-b211-57d7def6bf89', 'volume_name': 'volume-0fda88c6-94c6-4909-b211-57d7def6bf89', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fb7eb9-d0d5-4a64-9f1f-21f7f4e9c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fb7eb9-d0d5-4a64-9f1f-21f7f4e9c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1f00aa-d565-4780-92ca-bb681293d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Volume 0fda88c6-94c6-4909-b211-57d7def6bf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fda88c6-94c6-4909-b211-57d7def6bf89', 'volume_size': 1} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1728207465',display_name='tempest-VolumesGetTest-Volume-2090307297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fda88c6-94c6-4909-b211-57d7def6bf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:37Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Creating volume 0fda88c6-94c6-4909-b211-57d7def6bf89 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:36 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:36 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-da33492a-51ff-499c-bf4a-f6635e5f3e2a" returned: 0 in 0.526s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "cinder-quobyte-da33492a-51ff-499c-bf4a-f6635e5f3e2a" released by "delete_volume" :: held 1.377s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:36 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 1073741824 Aug 25 06:55:36 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:36 devstack cinder-volume[94487]: WARNING cinder.quota [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:36 devstack cinder-volume[94487]: WARNING cinder.quota [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:36 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Created reservations ['43343ddb-018a-4b09-81e2-210f06ca6df4', 'd7fc746a-cbae-493e-8c2c-d7899e8d4788', '084c6286-1fc3-41bf-a934-1ad65e541949', '998e3420-4b7e-454d-b25b-7b295d39ec66'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:37 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Acquiring lock "cinder-c4787f17-7d04-4d7c-a461-e979aa229cb5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "cinder-c4787f17-7d04-4d7c-a461-e979aa229cb5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Acquiring lock "cinder-quobyte-c4787f17-7d04-4d7c-a461-e979aa229cb5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "cinder-quobyte-c4787f17-7d04-4d7c-a461-e979aa229cb5" acquired by "delete_volume" :: waited 0.048s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c7398-940b-4806-b698-2f1a5415e3f1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.593s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:37 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 Aug 25 06:55:37 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Deleted volume successfully. Aug 25 06:55:37 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 1073741824" returned: 0 in 1.010s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-74253c9b-69d3-4088-9033-4acc33970852 tempest-VolumeRetypeWithoutMigrationTest-756301619 None] Lock "cinder-da33492a-51ff-499c-bf4a-f6635e5f3e2a-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 Aug 25 06:55:37 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:38 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1f00aa-d565-4780-92ca-bb681293d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fda88c6-94c6-4909-b211-57d7def6bf89', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce5a202-8bba-4a84-b069-f35c6df954c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:38 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Volume volume-0fda88c6-94c6-4909-b211-57d7def6bf89 (0fda88c6-94c6-4909-b211-57d7def6bf89): created successfully Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce5a202-8bba-4a84-b069-f35c6df954c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (60b04d53-853a-450f-a4d9-0dd99cc9bf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:38 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-423a0b76-8f1d-498c-a51c-ce3f6465ef2a tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:55:38 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5" returned: 0 in 0.880s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:38 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5 Aug 25 06:55:38 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:38 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c4787f17-7d04-4d7c-a461-e979aa229cb5" returned: 0 in 0.522s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "cinder-quobyte-c4787f17-7d04-4d7c-a461-e979aa229cb5" released by "delete_volume" :: held 1.501s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Created reservations ['b314eb21-bc6b-4834-b8e2-39ca3af92c77', '94fae922-d241-4f3c-ab00-0fcd5fd28996', 'dd9ef95d-281f-4c47-9d99-19b3df45d97c', '0184ebd3-5af3-4576-8c22-54b0aab181b8'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-0fda88c6-94c6-4909-b211-57d7def6bf89-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "cinder-0fda88c6-94c6-4909-b211-57d7def6bf89-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-0fda88c6-94c6-4909-b211-57d7def6bf89" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0fda88c6-94c6-4909-b211-57d7def6bf89" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:39 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:39 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd1f7f-7330-48f8-8a7c-7b33403f897a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:39 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 Aug 25 06:55:39 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:39 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.493s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Deleted volume successfully. Aug 25 06:55:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b045f6d-7bb4-43a4-828d-03b3f8ef3e94 tempest-ServerRescueNegativeTestJSON-1857641490 None] Lock "cinder-c4787f17-7d04-4d7c-a461-e979aa229cb5-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:40 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89" returned: 0 in 0.813s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:40 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89 Aug 25 06:55:40 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:40 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0fda88c6-94c6-4909-b211-57d7def6bf89" returned: 0 in 0.504s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0fda88c6-94c6-4909-b211-57d7def6bf89" released by "delete_volume" :: held 1.401s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:40 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Created reservations ['1dfdc0da-0d09-45c0-88c4-e96c284f53e7', 'd48b1721-b5b8-46a2-bb5a-8937f6530dca', '53dc48a1-8508-42da-a915-d9786ed5ccab', '90cb0314-d813-4391-a0d4-f8f0483364b7'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:41 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:41 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:41 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.796s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:55:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6064d485-7906-4205-93a2-5b2c9bcbe8eb tempest-VolumesGetTest-129930497 None] Lock "cinder-0fda88c6-94c6-4909-b211-57d7def6bf89-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-2f835cb0-71c7-4801-a394-281d6aec909a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "cinder-2f835cb0-71c7-4801-a394-281d6aec909a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-2f835cb0-71c7-4801-a394-281d6aec909a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-2f835cb0-71c7-4801-a394-281d6aec909a" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a73f7-7cda-4c61-a2c9-2b2bc03c3f7a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:42 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a Aug 25 06:55:42 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:43 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a" returned: 0 in 0.811s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:43 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a Aug 25 06:55:43 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:43 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f835cb0-71c7-4801-a394-281d6aec909a" returned: 0 in 0.681s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-2f835cb0-71c7-4801-a394-281d6aec909a" released by "delete_volume" :: held 1.574s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Created reservations ['9d9b7b92-7e4c-4113-92ac-847225400ab5', '71c60a8d-e540-48ee-bbbc-98711806fe3b', '5c80256b-c296-4359-a10a-79c351b447d0', '64712a57-2b68-4f54-96ee-28228a6bde49'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:44 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:55:44 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:44 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.752s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:44 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:55:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59b8e230-e4ec-4a99-973f-0c77ec937f39 tempest-VolumesGetTest-129930497 None] Lock "cinder-2f835cb0-71c7-4801-a394-281d6aec909a-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (17a7357e-4e89-4c6b-8441-7800f82f3b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c95c3c-202c-4fcd-8981-057bcab04aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c95c3c-202c-4fcd-8981-057bcab04aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-877267699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2200ac6d-9e93-4fce-bb7b-0b02db206d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:46Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773b2d32-a394-488d-bcd4-84e17df3fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773b2d32-a394-488d-bcd4-84e17df3fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764bb87-7fd1-44ee-aaf3-acef84375e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764bb87-7fd1-44ee-aaf3-acef84375e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'volume_name': 'volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30f6fe-fc38-498e-896b-19bd8f439d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30f6fe-fc38-498e-896b-19bd8f439d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6ec68-3a4f-459d-b4a6-67001e955318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:46 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Volume 2200ac6d-9e93-4fce-bb7b-0b02db206d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'volume_size': 1} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-877267699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2200ac6d-9e93-4fce-bb7b-0b02db206d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:46Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Creating volume 2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:46 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:46 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 1073741824 Aug 25 06:55:46 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:46 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 1073741824" returned: 0 in 0.592s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:46 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:55:46 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:47 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6ec68-3a4f-459d-b4a6-67001e955318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd00ab59-65cb-418e-8f3b-0e6b8dd21688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Volume volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 (2200ac6d-9e93-4fce-bb7b-0b02db206d37): created successfully Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd00ab59-65cb-418e-8f3b-0e6b8dd21688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (17a7357e-4e89-4c6b-8441-7800f82f3b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:47 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-58981ccc-839f-4d7b-8e95-7d21e1fc1e28 tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (90c61d00-21d0-49b2-95da-5c09e7f6411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475ee576-4c1a-40ca-beba-ae74a9a93f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475ee576-4c1a-40ca-beba-ae74a9a93f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1148686154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecb0612-c241-4726-882d-c0f65bdd65b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2200ac6d-9e93-4fce-bb7b-0b02db206d37,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:49Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1ebfd3-7f40-41df-b437-106ddb0105fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1ebfd3-7f40-41df-b437-106ddb0105fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddce0b0e-9e15-48ab-be27-676802ba7661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddce0b0e-9e15-48ab-be27-676802ba7661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0ecb0612-c241-4726-882d-c0f65bdd65b7', 'volume_name': 'volume-0ecb0612-c241-4726-882d-c0f65bdd65b7', 'volume_size': 1, 'source_volid': '2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'source_volstatus': 'available'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b906547-b4dc-483e-baf3-c026128e575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b906547-b4dc-483e-baf3-c026128e575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75953db-881c-4d92-a865-68481da02a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Volume 0ecb0612-c241-4726-882d-c0f65bdd65b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0ecb0612-c241-4726-882d-c0f65bdd65b7', 'volume_size': 1, 'source_volid': '2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'source_volstatus': 'available'} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:49 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Cloning volume 2200ac6d-9e93-4fce-bb7b-0b02db206d37 to volume 0ecb0612-c241-4726-882d-c0f65bdd65b7 Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Flow 'volume_create_manager' (bde2ae28-e231-42bb-86b4-b32615d65f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8e668b-30e7-4178-94ef-94ded48b739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8e668b-30e7-4178-94ef-94ded48b739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1924765077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa31c38d-6902-4f69-8d8e-ae56e18d673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a12b6a7e04523b919f7543c8149f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:49Z,use_quota=True,user_id='06f1f9f465724f9b8c39966453f2d675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe33d724-6572-45fa-8d84-0cd3ddfa50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe33d724-6572-45fa-8d84-0cd3ddfa50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa1957b-0e90-4155-871b-b3fec370e0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa1957b-0e90-4155-871b-b3fec370e0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa31c38d-6902-4f69-8d8e-ae56e18d673c', 'volume_name': 'volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3f010f-1c81-4326-9e67-235678203dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3f010f-1c81-4326-9e67-235678203dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc77f54-1ae5-41e2-9a86-e0fc9e5d4c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Volume aa31c38d-6902-4f69-8d8e-ae56e18d673c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c', 'volume_size': 1} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Creating offline snapshot 0ba22984-5bba-48b6-8b52-319764b12f75 of volume 2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd326fa-7ce3-4e6c-abe0-83f9b8743134]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:49 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:55:49 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:50 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.531s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:50 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 1G Aug 25 06:55:50 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:50 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 1G" returned: 0 in 0.505s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:50 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:55:50 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:51 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.435s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:51 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 is being set with open permissions: ugo+rw Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:51 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:55:51 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:51 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:51 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info Aug 25 06:55:51 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:51 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info" returned: 0 in 0.381s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:51 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info is being set with open permissions: ugo+rw Aug 25 06:55:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:51 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info Aug 25 06:55:51 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:52 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.info" returned: 0 in 0.327s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] snapshot: 0ba22984-5bba-48b6-8b52-319764b12f75, volume: 0ecb0612-c241-4726-882d-c0f65bdd65b7, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[853d1ab6-9e35-49cd-a4ac-240dea9270b3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:52 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:55:52 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:52 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.518s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd1714-0333-465b-ac89-cecf8a0d0b7e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:52 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:55:52 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:53 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.408s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:55:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:55:53 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:55:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:53 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 Aug 25 06:55:53 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:58 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7" returned: 0 in 5.763s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:58 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:55:58 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Converted 1024.00 MB image at 177.61 MB/s Aug 25 06:55:58 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 is being set with open permissions: ugo+rw Aug 25 06:55:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:59 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 Aug 25 06:55:59 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:59 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7" returned: 0 in 0.296s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" released by "_copy_volume_from_snapshot" :: held 7.111s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-0ba22984-5bba-48b6-8b52-319764b12f75" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ba22984-5bba-48b6-8b52-319764b12f75" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Deleting offline snapshot 0ba22984-5bba-48b6-8b52-319764b12f75 of volume 2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] snapshot_file for this snap is: volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d90182-5e39-4086-994d-0d965e46f512]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:59 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:55:59 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:59 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.402s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba4c703-29dd-4d4c-8a65-9f9fa2705feb]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:59 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:55:59 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:00 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.599s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:00 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:56:00 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:00 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.395s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:00 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:00 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:00 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75 Aug 25 06:56:00 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:01 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:56:01 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37.0ba22984-5bba-48b6-8b52-319764b12f75" returned: 0 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ba22984-5bba-48b6-8b52-319764b12f75" released by "_delete_snapshot" :: held 1.862s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.823s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.702s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1924765077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa31c38d-6902-4f69-8d8e-ae56e18d673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a12b6a7e04523b919f7543c8149f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:49Z,use_quota=True,user_id='06f1f9f465724f9b8c39966453f2d675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Creating volume aa31c38d-6902-4f69-8d8e-ae56e18d673c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:01 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75953db-881c-4d92-a865-68481da02a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecb0612-c241-4726-882d-c0f65bdd65b7', 'volume_size': 1, 'source_volid': '2200ac6d-9e93-4fce-bb7b-0b02db206d37', 'source_volstatus': 'available'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64e82f0-9463-4e03-baec-d3fb452eeeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c 1073741824 Aug 25 06:56:01 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Volume volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 (0ecb0612-c241-4726-882d-c0f65bdd65b7): created successfully Aug 25 06:56:01 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64e82f0-9463-4e03-baec-d3fb452eeeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (90c61d00-21d0-49b2-95da-5c09e7f6411d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-45392d63-44f1-4787-8bfa-bed45679520d tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Flow 'volume_create_manager' (03757dfd-b9e1-4c14-8d47-faf00d768e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b57b3-ee6d-4d4c-9123-c68446f6cd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b57b3-ee6d-4d4c-9123-c68446f6cd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1318798787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4ce6d0d5b24e03b23522bc624fc406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:01Z,use_quota=True,user_id='6edb0e9c78e14b41a1314836f412cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59b98bc-aca6-47c9-952e-21f08ceafc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59b98bc-aca6-47c9-952e-21f08ceafc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0b3365-abec-4f55-abcc-8c6fee11ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0b3365-abec-4f55-abcc-8c6fee11ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b', 'volume_name': 'volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8137412-3749-487a-bef3-0b8a53781226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8137412-3749-487a-bef3-0b8a53781226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687db5eb-4589-4d96-8dbf-b9f6d2f7c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:01 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Volume ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b', 'volume_size': 1} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:01 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c 1073741824" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:01 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c Aug 25 06:56:01 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:02 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c" returned: 0 in 0.252s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1318798787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4ce6d0d5b24e03b23522bc624fc406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:01Z,use_quota=True,user_id='6edb0e9c78e14b41a1314836f412cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Creating volume ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:02 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc77f54-1ae5-41e2-9a86-e0fc9e5d4c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:02 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b 1073741824 Aug 25 06:56:02 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccb7e40-eff6-4d48-a534-d4e4f86dbb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Volume volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c (aa31c38d-6902-4f69-8d8e-ae56e18d673c): created successfully Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccb7e40-eff6-4d48-a534-d4e4f86dbb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Flow 'volume_create_manager' (bde2ae28-e231-42bb-86b4-b32615d65f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-388e4309-36b0-43f5-955f-7ef7f0e75240 tempest-VolumesServicesTestJSON-1948884425 None] Created volume successfully. Aug 25 06:56:02 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b 1073741824" returned: 0 in 0.523s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:02 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b Aug 25 06:56:02 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Acquiring lock "cinder-aa31c38d-6902-4f69-8d8e-ae56e18d673c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "cinder-aa31c38d-6902-4f69-8d8e-ae56e18d673c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Acquiring lock "cinder-quobyte-aa31c38d-6902-4f69-8d8e-ae56e18d673c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "cinder-quobyte-aa31c38d-6902-4f69-8d8e-ae56e18d673c" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ac3d32-eba2-4f15-acf6-09013a6fd4d5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:03 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" returned: 0 in 0.355s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687db5eb-4589-4d96-8dbf-b9f6d2f7c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82a2c9-fd82-4fac-98c9-a9f72d5cc6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Volume volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b (ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b): created successfully Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82a2c9-fd82-4fac-98c9-a9f72d5cc6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Flow 'volume_create_manager' (03757dfd-b9e1-4c14-8d47-faf00d768e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ba26e6eb-a94d-41ff-8aff-4378fa9a86f9 req-f0fa14bc-9dba-43d8-b93b-5436c6bb8535 tempest-VolumesSnapshotsTestJSON-1608726717 None] Created volume successfully. Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:03 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c Aug 25 06:56:03 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (ac1e5658-bf4a-444c-8908-c16dff7dd1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcadbc5b-3772-4c30-bd60-4471cd1af09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcadbc5b-3772-4c30-bd60-4471cd1af09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124445864',display_name='tempest-VolumesGetTest-Volume-100168067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7171035-49aa-4d07-8dea-2ce0adff1dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:03Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706a043-9324-4a24-9444-94212740602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706a043-9324-4a24-9444-94212740602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4028dc93-1aae-4386-8162-0f99508f9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4028dc93-1aae-4386-8162-0f99508f9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7171035-49aa-4d07-8dea-2ce0adff1dbe', 'volume_name': 'volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e18f088-b218-476c-9edb-0a1c36a6ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e18f088-b218-476c-9edb-0a1c36a6ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c46277-aef4-4487-bef8-78936ee49c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Volume d7171035-49aa-4d07-8dea-2ce0adff1dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe', 'volume_size': 1} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124445864',display_name='tempest-VolumesGetTest-Volume-100168067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7171035-49aa-4d07-8dea-2ce0adff1dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:03Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Creating volume d7171035-49aa-4d07-8dea-2ce0adff1dbe {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:03 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:03 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe 1073741824 Aug 25 06:56:03 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:03 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:03 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c Aug 25 06:56:03 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:03 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aa31c38d-6902-4f69-8d8e-ae56e18d673c" returned: 0 in 0.342s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:03 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe 1073741824" returned: 0 in 0.554s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "cinder-quobyte-aa31c38d-6902-4f69-8d8e-ae56e18d673c" released by "delete_volume" :: held 0.865s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:03 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe Aug 25 06:56:03 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:03 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Created reservations ['f46cec2a-18fb-4da3-8fbe-2f18851f8e27', 'c80a4af0-a443-472f-901a-e34ffada13aa', '04fbd4e8-e7e1-43ee-9937-d895f1e3fb16', '14140654-0770-4c3c-9d4e-10ed21624baa'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:04 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:04 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:04 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe" returned: 0 in 0.403s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.189s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c46277-aef4-4487-bef8-78936ee49c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ed7853-784c-45ac-9961-d62f8207586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Creating offline snapshot 5162ffdf-057e-47c1-95fd-5f7a08264cc7 of volume ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:56:04 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Volume volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe (d7171035-49aa-4d07-8dea-2ce0adff1dbe): created successfully Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ed7853-784c-45ac-9961-d62f8207586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (ac1e5658-bf4a-444c-8908-c16dff7dd1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1eb52-6959-4d71-b9bb-6a9f1cdd26df]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd5106f5-a02c-49aa-95e6-0f873970617a tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:56:04 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b Aug 25 06:56:04 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:04 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.369s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Deleted volume successfully. Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5483a677-b70e-40ba-a068-99f87ef28a71 tempest-VolumesServicesTestJSON-1948884425 None] Lock "cinder-aa31c38d-6902-4f69-8d8e-ae56e18d673c-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:04 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" returned: 0 in 0.440s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:04 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 1G Aug 25 06:56:04 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:05 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 1G" returned: 0 in 0.507s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:05 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 Aug 25 06:56:05 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-d7171035-49aa-4d07-8dea-2ce0adff1dbe-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "cinder-d7171035-49aa-4d07-8dea-2ce0adff1dbe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-d7171035-49aa-4d07-8dea-2ce0adff1dbe" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-d7171035-49aa-4d07-8dea-2ce0adff1dbe" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab614d-ab38-4d0a-8138-42b0bb2c55b4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:05 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7" returned: 0 in 0.357s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 is being set with open permissions: ugo+rw Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:05 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 Aug 25 06:56:05 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:05 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe Aug 25 06:56:05 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:05 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7" returned: 0 in 0.278s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:05 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info Aug 25 06:56:06 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:06 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe Aug 25 06:56:06 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:06 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info" returned: 0 in 0.277s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info is being set with open permissions: ugo+rw Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d7171035-49aa-4d07-8dea-2ce0adff1dbe" returned: 0 in 0.278s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info Aug 25 06:56:06 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-d7171035-49aa-4d07-8dea-2ce0adff1dbe" released by "delete_volume" :: held 0.751s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Created reservations ['e907bd7c-ef5c-4a11-acce-b4c51b3ea857', '9f756ec2-4bae-45bc-9ca7-c42c33d7c1f8', '4d934b40-8f8c-4a11-ab0f-f7f4f5ed1d41', '88dfdb1f-dbe6-4b86-948b-08811f0aeae7'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:06 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:06 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.info" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-d10ff2f2-7215-4dd1-83b6-fe142f9e199b req-bb77c26d-769d-454c-8a5f-c04f57575f87 tempest-VolumesSnapshotsTestJSON-1608726717 None] Create snapshot completed successfully Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-0ecb0612-c241-4726-882d-c0f65bdd65b7-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "cinder-0ecb0612-c241-4726-882d-c0f65bdd65b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:06 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.321s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9762ed4d-12c7-4a8e-8cb5-5ca4cd6b200f tempest-VolumesGetTest-129930497 None] Lock "cinder-d7171035-49aa-4d07-8dea-2ce0adff1dbe-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6328a1e-0aae-4edb-978b-0ff43cece834]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 Aug 25 06:56:06 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:07 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7" returned: 0 in 0.386s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:07 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7 Aug 25 06:56:07 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:07 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0ecb0612-c241-4726-882d-c0f65bdd65b7" returned: 0 in 0.275s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-0ecb0612-c241-4726-882d-c0f65bdd65b7" released by "delete_volume" :: held 0.711s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=133,cinder:SELECT=95,cinder:INSERT=24,cinder:DELETE=10 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=116,cinder:SELECT=98,cinder:INSERT=31,cinder:DELETE=8 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Created reservations ['a65a0a67-b223-4a16-9c66-d0f8af94fc52', '1d1aaa6f-2bd2-4398-9d8a-574b8fa87518', '4f6f52dd-2b2b-42df-b64a-ce2624a9fdc5', '2096fde0-b6f2-49fa-8cf9-f9593245885a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "cinder-5162ffdf-057e-47c1-95fd-5f7a08264cc7-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-5162ffdf-057e-47c1-95fd-5f7a08264cc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "cinder-quobyte-5162ffdf-057e-47c1-95fd-5f7a08264cc7" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-5162ffdf-057e-47c1-95fd-5f7a08264cc7" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Deleting offline snapshot 5162ffdf-057e-47c1-95fd-5f7a08264cc7 of volume ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:56:07 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:07 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] snapshot_file for this snap is: volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0dfa3-638a-48f3-8db1-cb1339b57899]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:07 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 Aug 25 06:56:07 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-2200ac6d-9e93-4fce-bb7b-0b02db206d37-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "cinder-2200ac6d-9e93-4fce-bb7b-0b02db206d37-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:08 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-2200ac6d-9e93-4fce-bb7b-0b02db206d37" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6dab3b89-d0fe-40f7-9078-66e92aa17b8f tempest-VolumesGetTest-129930497 None] Lock "cinder-0ecb0612-c241-4726-882d-c0f65bdd65b7-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-2200ac6d-9e93-4fce-bb7b-0b02db206d37" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5486a58-f480-47c8-a2c2-dd5baabad100]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:08 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7" returned: 0 in 0.473s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c726a02-2c44-4a22-a367-e3dfae916711]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:08 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:56:08 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:08 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b Aug 25 06:56:08 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:08 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:08 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37 Aug 25 06:56:08 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:08 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:08 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 Aug 25 06:56:08 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:08 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2200ac6d-9e93-4fce-bb7b-0b02db206d37" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-2200ac6d-9e93-4fce-bb7b-0b02db206d37" released by "delete_volume" :: held 0.710s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:08 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Created reservations ['77237aec-e7e4-4c4b-b618-e6c3d1a2d2ad', '53b4457f-7e85-4ad9-a386-dcc7048376d2', 'f67f6d5a-ba89-4c77-8411-b27f6e9e0bf0', '69767993-f297-4efa-9bf0-a5531b1ed508'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:09 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:09 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:09 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:09 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7 Aug 25 06:56:09 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:09 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a69dd447-b730-4ff3-b0c5-b35748a966a6 tempest-VolumesGetTest-129930497 None] Lock "cinder-2200ac6d-9e93-4fce-bb7b-0b02db206d37-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:09 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b.5162ffdf-057e-47c1-95fd-5f7a08264cc7" returned: 0 in 0.303s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-5162ffdf-057e-47c1-95fd-5f7a08264cc7" released by "_delete_snapshot" :: held 1.702s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" released by "delete_snapshot" :: held 1.753s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.quota [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Created reservations ['ca0f8cba-261e-46e4-9f2d-9385343da68d', '7c56fdcb-6a2e-4354-819f-58806ca71e82', '66fad09e-010a-4835-9ec3-4f68a3c588f4', 'd1a224f5-ffe8-4503-81fc-419bd0ea48d6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Delete snapshot completed successfully. Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-45d417f5-5e75-496d-b5b6-853bd0f916aa req-7ff4c259-e09e-413d-9c6a-69e452a16fd6 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-5162ffdf-057e-47c1-95fd-5f7a08264cc7-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "cinder-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[26589e3e-138d-4fd9-98f2-0163680fb98d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (630c62fd-1fa5-4dd7-b36d-928ed045a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0572e96f-b722-4409-87a3-e96c411974d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0572e96f-b722-4409-87a3-e96c411974d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-885170285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60eeb74-0181-49a1-93a0-e232a7eff699,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:10Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaf12b2-a038-49de-b0d5-1c13239f4806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaf12b2-a038-49de-b0d5-1c13239f4806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0c558-0751-4e32-9628-9f022a3488e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:56:10 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b Aug 25 06:56:10 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:10 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:10 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b Aug 25 06:56:10 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0c558-0751-4e32-9628-9f022a3488e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a60eeb74-0181-49a1-93a0-e232a7eff699', 'volume_name': 'volume-a60eeb74-0181-49a1-93a0-e232a7eff699', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4749f5dd-9b64-4b2d-bbd1-c7dbbf443a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4749f5dd-9b64-4b2d-bbd1-c7dbbf443a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413089df-6d04-46d0-827e-bbc835a8ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:10 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Volume a60eeb74-0181-49a1-93a0-e232a7eff699: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a60eeb74-0181-49a1-93a0-e232a7eff699', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Trying to clone a60eeb74-0181-49a1-93a0-e232a7eff699 from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:56:10 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" returned: 0 in 0.313s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-quobyte-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b" released by "delete_volume" :: held 0.813s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:10 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:56:10 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.quota [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Created reservations ['a0a24781-88e5-40a6-9471-5da7e67729dd', 'd502cffb-5041-4ae0-9517-92703c9eebb0', '067b76d5-a2b4-4f6d-a9da-c5e23368e673', 'a2385bbb-3264-4e9a-adea-2825d4f62856'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94de2f4-1e7f-4c00-a06e-cf75ff7e6497]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:11 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:11 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD Aug 25 06:56:11 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:11 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:11 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a is fetched for user 3b8e2eaa6a4f408082b8f61bc5135402. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:56:11 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.319s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.manager [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Deleted volume successfully. Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-d35cb990-90b3-40b1-8c2e-841a2cb71f8d req-16e7ad46-887d-47f0-9cff-1a410c7dbf75 tempest-VolumesSnapshotsTestJSON-1608726717 None] Lock "cinder-ad8dc9f7-99ea-43bb-9b8d-06b9d368bd4b-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d6537-f46c-4b0f-83ef-518c11d3825e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:11 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD Aug 25 06:56:11 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:11 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-885170285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60eeb74-0181-49a1-93a0-e232a7eff699,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:10Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Creating volume a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:11 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:11 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1073741824 Aug 25 06:56:11 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:12 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1073741824" returned: 0 in 0.566s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:12 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 Aug 25 06:56:12 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:12 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699" returned: 0 in 0.319s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Attempting download of 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume a60eeb74-0181-49a1-93a0-e232a7eff699. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc898a28-bf26-4b42-826f-88c7bc3e54b3]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:13 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g Aug 25 06:56:13 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:13 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g" returned: 0 in 0.409s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:13 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g Aug 25 06:56:13 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:13 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g" returned: 1 in 0.502s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_sdvznb7g' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0124437-b826-45aa-8d76-0575822f0324]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:14 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD Aug 25 06:56:14 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:14 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:14 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:56:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:14 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 Aug 25 06:56:14 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (77dc2a09-94a7-4ec1-9333-999579d71367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3ee375-b8c1-4b14-b2ad-96d11b66a31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3ee375-b8c1-4b14-b2ad-96d11b66a31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656937889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d2b28e-d922-4857-b409-97e6eee15569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:16Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ce170-9463-4e9b-90f6-b4576a9ee0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ce170-9463-4e9b-90f6-b4576a9ee0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8457ee05-cfff-49a2-9632-e554f826c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8457ee05-cfff-49a2-9632-e554f826c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d2b28e-d922-4857-b409-97e6eee15569', 'volume_name': 'volume-11d2b28e-d922-4857-b409-97e6eee15569', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543dd75-794d-43ee-a448-8d058a1874ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543dd75-794d-43ee-a448-8d058a1874ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af39ee-4678-4afc-bff0-46a8c1fe19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Volume 11d2b28e-d922-4857-b409-97e6eee15569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d2b28e-d922-4857-b409-97e6eee15569', 'volume_size': 1} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656937889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d2b28e-d922-4857-b409-97e6eee15569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:16Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Creating volume 11d2b28e-d922-4857-b409-97e6eee15569 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:16 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:16 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 1073741824 Aug 25 06:56:16 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:16 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699" returned: 0 in 2.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_yosegmjfdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:56:16 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Converted 112.00 MB image at 47.72 MB/s Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:16 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1G Aug 25 06:56:16 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:16 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 1073741824" returned: 0 in 0.561s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:16 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 Aug 25 06:56:16 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:17 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 1G" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Downloaded image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume a60eeb74-0181-49a1-93a0-e232a7eff699 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a for user 3b8e2eaa6a4f408082b8f61bc5135402 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Marking volume a60eeb74-0181-49a1-93a0-e232a7eff699 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:56:17 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569" returned: 0 in 0.298s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af39ee-4678-4afc-bff0-46a8c1fe19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d2b28e-d922-4857-b409-97e6eee15569', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8423e986-6498-4a3c-bd5b-7cea1f3c7a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Copying metadata from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a to a60eeb74-0181-49a1-93a0-e232a7eff699. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Creating volume glance metadata for volume a60eeb74-0181-49a1-93a0-e232a7eff699 backed by image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Volume volume-11d2b28e-d922-4857-b409-97e6eee15569 (11d2b28e-d922-4857-b409-97e6eee15569): created successfully Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8423e986-6498-4a3c-bd5b-7cea1f3c7a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (77dc2a09-94a7-4ec1-9333-999579d71367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7942eddc-db5a-42af-b7bd-ccbf26a2836e tempest-AttachVolumeNegativeTest-857282591 None] Created volume successfully. Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413089df-6d04-46d0-827e-bbc835a8ac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60eeb74-0181-49a1-93a0-e232a7eff699', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67341ef0-ee9a-4aa0-9818-ee4d77a1ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Volume volume-a60eeb74-0181-49a1-93a0-e232a7eff699 (a60eeb74-0181-49a1-93a0-e232a7eff699): created successfully Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67341ef0-ee9a-4aa0-9818-ee4d77a1ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (630c62fd-1fa5-4dd7-b36d-928ed045a07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ff73be48-f027-4162-9558-79c514969595 tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d0e6cc0-26a4-46a1-9cec-ecaa9318edcb tempest-GroupsTest-1329634696 None] Group tempest-Group1-544526936: creating Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d0e6cc0-26a4-46a1-9cec-ecaa9318edcb tempest-GroupsTest-1329634696 None] Group tempest-Group1-544526936: created successfully Aug 25 06:56:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d0e6cc0-26a4-46a1-9cec-ecaa9318edcb tempest-GroupsTest-1329634696 None] Create group completed successfully. Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Flow 'volume_create_manager' (38baa602-ca3c-470a-a301-92f77e88c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc70881-ac2b-4427-8222-3049be4dc1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc70881-ac2b-4427-8222-3049be4dc1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2126580533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac952e2c-ee89-4a9e-85d2-ce9edc3740b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddbb09cd7b2477ab8e1c31c35a96f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:18Z,use_quota=True,user_id='47b76e5fdb8d4489b2b65fab43477605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d65ecb-2050-40f9-a639-a0ae1cffe9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d65ecb-2050-40f9-a639-a0ae1cffe9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d471a9-13a0-4a25-adc2-bdb81494c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d471a9-13a0-4a25-adc2-bdb81494c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac952e2c-ee89-4a9e-85d2-ce9edc3740b6', 'volume_name': 'volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e55aa-fd7d-4115-8e76-fa438b67aa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e55aa-fd7d-4115-8e76-fa438b67aa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d35947-a5c4-4a4c-beec-882068836b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Volume ac952e2c-ee89-4a9e-85d2-ce9edc3740b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6', 'volume_size': 1} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2126580533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac952e2c-ee89-4a9e-85d2-ce9edc3740b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddbb09cd7b2477ab8e1c31c35a96f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:18Z,use_quota=True,user_id='47b76e5fdb8d4489b2b65fab43477605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Creating volume ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:18 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 1073741824 Aug 25 06:56:18 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (7334e497-f4ee-4530-a669-7c93408f6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f477540b-399f-4f6c-a6b3-a2e7a8075227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f477540b-399f-4f6c-a6b3-a2e7a8075227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1648901037',display_name='tempest-VolumesGetTest-Volume-527889251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6512ff5-5e71-4239-ab54-e45c94e8753a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:18Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a655ed91-99d4-41b9-9833-4ddab89bdceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a655ed91-99d4-41b9-9833-4ddab89bdceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0666272-56fb-4b08-968c-e61bcb3568c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0666272-56fb-4b08-968c-e61bcb3568c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6512ff5-5e71-4239-ab54-e45c94e8753a', 'volume_name': 'volume-e6512ff5-5e71-4239-ab54-e45c94e8753a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77516ce6-bcfa-42f6-aad1-7ea5943b04b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77516ce6-bcfa-42f6-aad1-7ea5943b04b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c6dd13-fbee-419f-a799-7e49db55798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Volume e6512ff5-5e71-4239-ab54-e45c94e8753a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6512ff5-5e71-4239-ab54-e45c94e8753a', 'volume_size': 1} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c5acad7a-789c-4009-99e2-76082b624dbe tempest-GroupsTest-1329634696 None] Group tempest-Group2-822061057: creating Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c5acad7a-789c-4009-99e2-76082b624dbe tempest-GroupsTest-1329634696 None] Group tempest-Group2-822061057: created successfully Aug 25 06:56:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c5acad7a-789c-4009-99e2-76082b624dbe tempest-GroupsTest-1329634696 None] Create group completed successfully. Aug 25 06:56:18 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 1073741824" returned: 0 in 0.553s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:18 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 Aug 25 06:56:18 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:19 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" returned: 0 in 0.261s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1648901037',display_name='tempest-VolumesGetTest-Volume-527889251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6512ff5-5e71-4239-ab54-e45c94e8753a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0390710b795148e894a0db0cd447f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:18Z,use_quota=True,user_id='3b8e2eaa6a4f408082b8f61bc5135402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Creating volume e6512ff5-5e71-4239-ab54-e45c94e8753a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:19 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:19 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a 1073741824 Aug 25 06:56:19 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d35947-a5c4-4a4c-beec-882068836b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0887f1d-b791-4bce-ab64-603afb470227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-86b36126-403a-4aea-bf6c-bd4acfadb68e req-962bd6d9-b455-4a37-bb2f-e6968109b4d1 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Volume volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 (ac952e2c-ee89-4a9e-85d2-ce9edc3740b6): created successfully Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0887f1d-b791-4bce-ab64-603afb470227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Flow 'volume_create_manager' (38baa602-ca3c-470a-a301-92f77e88c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2d031ef1-2de5-4765-a50c-62d736978ed1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Created volume successfully. Aug 25 06:56:19 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a 1073741824" returned: 0 in 0.441s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:19 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a Aug 25 06:56:19 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:19 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a" returned: 0 in 0.237s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-86b36126-403a-4aea-bf6c-bd4acfadb68e req-962bd6d9-b455-4a37-bb2f-e6968109b4d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.673s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c6dd13-fbee-419f-a799-7e49db55798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6512ff5-5e71-4239-ab54-e45c94e8753a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b027ec6a-76a9-403b-8aa2-1e798ffc8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-86b36126-403a-4aea-bf6c-bd4acfadb68e req-962bd6d9-b455-4a37-bb2f-e6968109b4d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Volume volume-e6512ff5-5e71-4239-ab54-e45c94e8753a (e6512ff5-5e71-4239-ab54-e45c94e8753a): created successfully Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b027ec6a-76a9-403b-8aa2-1e798ffc8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Flow 'volume_create_manager' (7334e497-f4ee-4530-a669-7c93408f6491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-350ed0cb-9423-4917-b6b6-e4f0d558fc4a tempest-VolumesGetTest-129930497 None] Created volume successfully. Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-86b36126-403a-4aea-bf6c-bd4acfadb68e req-962bd6d9-b455-4a37-bb2f-e6968109b4d1 tempest-AttachVolumeNegativeTest-857282591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-11d2b28e-d922-4857-b409-97e6eee15569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '322f5917-c58b-47e1-90f7-be62df4c2b19', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:56:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-86b36126-403a-4aea-bf6c-bd4acfadb68e req-962bd6d9-b455-4a37-bb2f-e6968109b4d1 tempest-AttachVolumeNegativeTest-857282591 None] attachment_update completed successfully. Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (19a4ef60-cb25-4cf0-8f60-f4698eeacd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d817dc4-34c8-4a7e-960c-597f05f541c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d817dc4-34c8-4a7e-960c-597f05f541c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-461857037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b67cc21-592a-4838-a990-c541592ea23d,host='devstack@QuobyteHD#QuobyteHD',id=0f5241bd-04a2-47a5-9204-81fe17a29b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:20Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d7bc4e-3dd8-4705-8ccd-bea29a7171fd),volume_type_id=d0d7bc4e-3dd8-4705-8ccd-bea29a7171fd)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca995be-cbd9-45b9-aa49-27dc8545c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca995be-cbd9-45b9-aa49-27dc8545c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c3ccd3-cf94-42cd-ae57-c833a3a32c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c3ccd3-cf94-42cd-ae57-c833a3a32c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5241bd-04a2-47a5-9204-81fe17a29b13', 'volume_name': 'volume-0f5241bd-04a2-47a5-9204-81fe17a29b13', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08067d3a-3259-481c-9500-43c33164509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08067d3a-3259-481c-9500-43c33164509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b29983c-e49f-4290-9569-b5a5ecf350d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Volume 0f5241bd-04a2-47a5-9204-81fe17a29b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5241bd-04a2-47a5-9204-81fe17a29b13', 'volume_size': 1} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b67cc21-592a-4838-a990-c541592ea23d,created_at=2026-08-25T04:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-461857037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b67cc21-592a-4838-a990-c541592ea23d,host='devstack@QuobyteHD#QuobyteHD',id=0f5241bd-04a2-47a5-9204-81fe17a29b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:20Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d7bc4e-3dd8-4705-8ccd-bea29a7171fd),volume_type_id=d0d7bc4e-3dd8-4705-8ccd-bea29a7171fd)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Creating volume 0f5241bd-04a2-47a5-9204-81fe17a29b13 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:20 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:20 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 1073741824 Aug 25 06:56:20 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:21 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-e6512ff5-5e71-4239-ab54-e45c94e8753a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 1073741824" returned: 0 in 0.499s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "cinder-e6512ff5-5e71-4239-ab54-e45c94e8753a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-e6512ff5-5e71-4239-ab54-e45c94e8753a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:21 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 Aug 25 06:56:21 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-e6512ff5-5e71-4239-ab54-e45c94e8753a" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb09e8-6bd3-4486-973d-4e092511cc3f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:21 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a Aug 25 06:56:21 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:21 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13" returned: 0 in 0.275s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b29983c-e49f-4290-9569-b5a5ecf350d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5241bd-04a2-47a5-9204-81fe17a29b13', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a802076-cc5e-4e7f-bbab-0e67e80e9e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Creating offline snapshot 4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e of volume ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:56:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Volume volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 (0f5241bd-04a2-47a5-9204-81fe17a29b13): created successfully Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a802076-cc5e-4e7f-bbab-0e67e80e9e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (19a4ef60-cb25-4cf0-8f60-f4698eeacd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76bdfb9-4f0f-4285-9eeb-4f2c9393be95]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-04f0148c-5898-4095-9f99-8ddbb692ed12 tempest-GroupsTest-1329634696 None] Created volume successfully. Aug 25 06:56:21 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 Aug 25 06:56:21 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:21 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a" returned: 0 in 0.422s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:21 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a Aug 25 06:56:21 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:21 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" returned: 0 in 0.403s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:21 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e6512ff5-5e71-4239-ab54-e45c94e8753a" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:21 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e 1G Aug 25 06:56:21 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-e6512ff5-5e71-4239-ab54-e45c94e8753a" released by "delete_volume" :: held 0.758s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Created reservations ['e575b9da-f637-45ae-98fb-142f9bb51694', '4bbe6f76-9b84-4c10-a2ae-bc5286b457a0', '53873bb8-44be-44c9-a502-fdb4db2e23ed', 'a90340a3-f85b-47c2-99fd-15f0aea9d612'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:22 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Acquiring lock "cinder-quobyte-0f5241bd-04a2-47a5-9204-81fe17a29b13" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-0f5241bd-04a2-47a5-9204-81fe17a29b13" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-a60eeb74-0181-49a1-93a0-e232a7eff699-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[390f3700-c38f-45dd-ad83-e4a41e8fe6b1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "cinder-a60eeb74-0181-49a1-93a0-e232a7eff699-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:22 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.336s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Acquiring lock "cinder-quobyte-a60eeb74-0181-49a1-93a0-e232a7eff699" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6f4b87d1-42b8-4dc2-a77c-7025e2ca62f1 tempest-VolumesGetTest-129930497 None] Lock "cinder-e6512ff5-5e71-4239-ab54-e45c94e8753a-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-a60eeb74-0181-49a1-93a0-e232a7eff699" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:22 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e 1G" returned: 0 in 0.616s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4ef40-3ed1-4e61-a8f8-04407e220c4b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e Aug 25 06:56:22 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:22 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 Aug 25 06:56:22 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:22 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 Aug 25 06:56:22 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:22 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13" returned: 0 in 0.538s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" returned: 0 in 0.381s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:22 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e is being set with open permissions: ugo+rw Aug 25 06:56:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:22 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13 Aug 25 06:56:22 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:22 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e Aug 25 06:56:22 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:23 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699" returned: 0 in 0.466s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:23 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699 Aug 25 06:56:23 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:23 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0f5241bd-04a2-47a5-9204-81fe17a29b13" returned: 0 in 0.313s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-0f5241bd-04a2-47a5-9204-81fe17a29b13" released by "delete_volume" :: held 0.918s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:23 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:23 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a60eeb74-0181-49a1-93a0-e232a7eff699" returned: 0 in 0.278s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "cinder-quobyte-a60eeb74-0181-49a1-93a0-e232a7eff699" released by "delete_volume" :: held 0.814s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:23 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info Aug 25 06:56:23 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Created reservations ['e057b465-ed92-4041-8c88-33a8ce93fd89'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:23 devstack cinder-volume[94487]: WARNING cinder.quota [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1596849982 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1596849982, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:23 devstack cinder-volume[94487]: WARNING cinder.quota [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1596849982 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1596849982, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Created reservations ['441b560a-032e-4a4e-890d-5d968fd01a5b', '9820912e-f5c2-4387-b45f-1b8808775c77', '8fc46d9c-6b9f-4370-802e-00615ff2ca3e', '79ea0139-35e9-4ad1-8a77-552583271929'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Created reservations ['42832547-03c9-485f-a321-42150f05fb28', '59717ba5-7b7d-4c59-b8ef-7cf58ac5e9e4', '26ecb722-82b0-4165-8bdf-9891e04abd3a', 'eaa5d33c-e9af-4219-81d2-89bf885ba3d5'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:23 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:23 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:23 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info" returned: 0 in 0.409s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:23 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info is being set with open permissions: ugo+rw Aug 25 06:56:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:23 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:23 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:23 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info Aug 25 06:56:23 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:24 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.449s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Deleted volume successfully. Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2f10bdf0-6fe9-4275-80a4-30858ac7b9dd tempest-VolumesGetTest-129930497 None] Lock "cinder-a60eeb74-0181-49a1-93a0-e232a7eff699-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:24 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.info" returned: 0 in 0.342s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:24 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.416s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-eac405bb-c42c-46d6-929e-19f5ece1cb15 tempest-GroupsTest-1329634696 None] Delete group completed successfully. Aug 25 06:56:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0fb47f05-7e83-4a2d-9f3f-b1572034a706 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Create snapshot completed successfully Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Created reservations ['76c4976d-deb6-4434-b9d9-e01f42f8afd6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:24 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:24 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:25 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5f734d06-57f4-4e02-a3cb-28ebc31001b2 tempest-GroupsTest-1329634696 None] Delete group completed successfully. Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "cinder-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "cinder-quobyte-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Deleting offline snapshot 4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e of volume ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] snapshot_file for this snap is: volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c480ba-292c-4856-97b4-ea2f48995f65]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:25 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e Aug 25 06:56:25 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:26 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" returned: 0 in 0.439s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1a5639-639d-4fdd-a88a-5c0992bbefe4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:26 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 Aug 25 06:56:26 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:26 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" returned: 0 in 0.430s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:26 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e Aug 25 06:56:26 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8ac849eb-c1fc-40df-9cd9-124f257f8c36 tempest-GroupsTest-1329634696 None] Group tempest-GroupsTest-Group-1719635970: creating Aug 25 06:56:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8ac849eb-c1fc-40df-9cd9-124f257f8c36 tempest-GroupsTest-1329634696 None] Group tempest-GroupsTest-Group-1719635970: created successfully Aug 25 06:56:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8ac849eb-c1fc-40df-9cd9-124f257f8c36 tempest-GroupsTest-1329634696 None] Create group completed successfully. Aug 25 06:56:26 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" returned: 0 in 0.472s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:26 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e Aug 25 06:56:26 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:27 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6.4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" returned: 0 in 0.301s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e" released by "_delete_snapshot" :: held 1.800s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" released by "delete_snapshot" :: held 1.837s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Created reservations ['43a751c4-62c9-415c-a6f6-ff2af89d4b87', '6f1923aa-d9ba-4aac-831e-b5a4b59c9668', 'eedba704-4dfc-4adb-aba9-b9f9e76e6aee', '5cc86a2a-04e0-4bff-bfaa-df0e1b69c92e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (3663b1d6-ddea-429e-baae-5d3488e20ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd47197-c119-4999-bd18-a8df3a08ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Delete snapshot completed successfully. Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-eb3df524-c2a1-47e1-aae8-511437533b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-4c4487bf-8c2f-4078-9cd9-388c4ddbfd9e-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd47197-c119-4999-bd18-a8df3a08ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-824039227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bdcc7a-ec1a-4185-adc0-7a193bc48e27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:27Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f8969b-0831-4814-9ba0-e22833cda551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f8969b-0831-4814-9ba0-e22833cda551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3933f7e2-6a0e-4cfe-bbfb-a3a30a83c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3933f7e2-6a0e-4cfe-bbfb-a3a30a83c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bdcc7a-ec1a-4185-adc0-7a193bc48e27', 'volume_name': 'volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ab6590-fc0e-461c-b000-ec45a26d7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ab6590-fc0e-461c-b000-ec45a26d7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2099e525-e16d-4867-8b26-7c492025eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Volume 14bdcc7a-ec1a-4185-adc0-7a193bc48e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27', 'volume_size': 1} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-824039227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bdcc7a-ec1a-4185-adc0-7a193bc48e27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:27Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Creating volume 14bdcc7a-ec1a-4185-adc0-7a193bc48e27 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:27 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:27 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 1073741824 Aug 25 06:56:27 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "cinder-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3956a8d-2cf9-4b2c-ad72-702ca9a1a8bd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:28 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 Aug 25 06:56:28 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:28 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 1073741824" returned: 0 in 0.731s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:28 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 Aug 25 06:56:28 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:28 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" returned: 0 in 0.715s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:28 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6 Aug 25 06:56:28 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (6ea8c515-fcf9-49fa-9cca-afdfc349f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34139021-b71c-435a-bcf7-9b6d1388fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34139021-b71c-435a-bcf7-9b6d1388fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330063174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,host='devstack@QuobyteHD#QuobyteHD',id=99697751-2d69-4f51-98d1-fe5c32b66940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:29Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(713cff50-b414-4280-aeba-1159cbf65413),volume_type_id=713cff50-b414-4280-aeba-1159cbf65413)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e42c0-86db-4b34-ad09-202eae3ccf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e42c0-86db-4b34-ad09-202eae3ccf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:28 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61332258-5758-4503-9c64-58723e6fa28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61332258-5758-4503-9c64-58723e6fa28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99697751-2d69-4f51-98d1-fe5c32b66940', 'volume_name': 'volume-99697751-2d69-4f51-98d1-fe5c32b66940', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808ce7a6-25f5-42fa-9ebe-5b3096a81bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808ce7a6-25f5-42fa-9ebe-5b3096a81bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daecd3ec-fc61-4e0d-84d8-7c6b2597ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Volume 99697751-2d69-4f51-98d1-fe5c32b66940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99697751-2d69-4f51-98d1-fe5c32b66940', 'volume_size': 1} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" returned: 0 in 0.504s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,created_at=2026-08-25T04:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330063174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,host='devstack@QuobyteHD#QuobyteHD',id=99697751-2d69-4f51-98d1-fe5c32b66940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:29Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(713cff50-b414-4280-aeba-1159cbf65413),volume_type_id=713cff50-b414-4280-aeba-1159cbf65413)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Creating volume 99697751-2d69-4f51-98d1-fe5c32b66940 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:28 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2099e525-e16d-4867-8b26-7c492025eb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96af8016-4491-42c8-ba73-0c7aa70d0dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:28 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 1073741824 Aug 25 06:56:28 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Volume volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 (14bdcc7a-ec1a-4185-adc0-7a193bc48e27): created successfully Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96af8016-4491-42c8-ba73-0c7aa70d0dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (3663b1d6-ddea-429e-baae-5d3488e20ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:29 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2b2e166f-0c4d-46b0-8bae-0454b39004fc tempest-VolumesListTestJSON-175828512 None] Created volume successfully. Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-quobyte-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6" released by "delete_volume" :: held 1.191s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Created reservations ['e14374a3-0277-43a6-898b-a73c4913ac60', '7b534fe8-c974-48bb-8c5b-a33de4b00d04', '7ac24d71-d3b2-4e35-b9cd-7c2e1b5c78c8', '5b68076f-f779-4aac-bb0e-7d4810aa7e8c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:29 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:29 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:29 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 1073741824" returned: 0 in 0.754s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:29 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.445s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Deleted volume successfully. Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-43025fd1-31a9-4de9-b6cc-c982c87b5888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1636614930 None] Lock "cinder-ac952e2c-ee89-4a9e-85d2-ce9edc3740b6-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:29 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 Aug 25 06:56:29 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:30 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daecd3ec-fc61-4e0d-84d8-7c6b2597ad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99697751-2d69-4f51-98d1-fe5c32b66940', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e845a3b8-cb31-40f2-bb5c-ee86eae0ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Volume volume-99697751-2d69-4f51-98d1-fe5c32b66940 (99697751-2d69-4f51-98d1-fe5c32b66940): created successfully Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e845a3b8-cb31-40f2-bb5c-ee86eae0ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (6ea8c515-fcf9-49fa-9cca-afdfc349f074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4ce2a0c3-da06-4b02-b5a7-e66317ba75ae tempest-GroupsTest-1329634696 None] Created volume successfully. Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (516c4299-c3d6-459e-a3da-52a164b83d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3342b014-d687-4138-bcde-1eda9029ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3342b014-d687-4138-bcde-1eda9029ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1161570144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:30Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14851ebe-0a80-4c35-ab15-7ba51292fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14851ebe-0a80-4c35-ab15-7ba51292fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72737f3b-fe93-43d2-aace-d8fb15b59756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72737f3b-fe93-43d2-aace-d8fb15b59756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8', 'volume_name': 'volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40219c4-05df-4ff3-a196-f9e5b70aee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40219c4-05df-4ff3-a196-f9e5b70aee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3eb739e-8296-4fa4-8fdb-d1fe6533793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:30 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Volume 4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8', 'volume_size': 1} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1161570144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:30Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Creating volume 4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:30 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:30 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 1073741824 Aug 25 06:56:30 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:31 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 1073741824" returned: 0 in 0.584s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:31 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 Aug 25 06:56:31 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:31 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3eb739e-8296-4fa4-8fdb-d1fe6533793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb779d47-671c-4de1-8c6f-637570e6086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:31 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Volume volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 (4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8): created successfully Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb779d47-671c-4de1-8c6f-637570e6086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (516c4299-c3d6-459e-a3da-52a164b83d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-26c2962b-a4a4-4326-9722-7fc623237946 tempest-VolumesListTestJSON-175828512 None] Created volume successfully. Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (ef83cef8-5db1-49e4-8cf0-cbd92102a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3516f9df-7cad-41b3-b56d-bbb961f7528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3516f9df-7cad-41b3-b56d-bbb961f7528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656439767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,host='devstack@QuobyteHD#QuobyteHD',id=70428f04-a6d1-4ae0-a945-0bf57ccb6ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:33Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(713cff50-b414-4280-aeba-1159cbf65413),volume_type_id=713cff50-b414-4280-aeba-1159cbf65413)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa33fdf3-f42b-4802-86ca-80a538447af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa33fdf3-f42b-4802-86ca-80a538447af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a10b6d-3ff1-4275-bbf7-27c2cf5a7419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a10b6d-3ff1-4275-bbf7-27c2cf5a7419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70428f04-a6d1-4ae0-a945-0bf57ccb6ba3', 'volume_name': 'volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae3af23-a772-4e09-bb89-1e56ec6f5cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae3af23-a772-4e09-bb89-1e56ec6f5cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d8449-5b7d-4061-bfc9-cc35b2df2c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Volume 70428f04-a6d1-4ae0-a945-0bf57ccb6ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3', 'volume_size': 1} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,created_at=2026-08-25T04:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656439767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a9abe40-161a-46fb-9090-90c5ac99a32b,host='devstack@QuobyteHD#QuobyteHD',id=70428f04-a6d1-4ae0-a945-0bf57ccb6ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc17d882debd4bd7aa8a5ec3385e5635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:33Z,use_quota=True,user_id='375edaa276b848498f8857ed233824b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(713cff50-b414-4280-aeba-1159cbf65413),volume_type_id=713cff50-b414-4280-aeba-1159cbf65413)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Creating volume 70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:32 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:32 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 1073741824 Aug 25 06:56:32 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (9d92b9d9-3b57-4eb4-bbc4-313e1f98939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7629d59d-b46a-401f-81be-6499cb45fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7629d59d-b46a-401f-81be-6499cb45fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-638995636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef93444-9492-4dcc-a0ca-4f31a080f9c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:33Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f5f85d-2d48-42ec-8e93-4e266b810c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f5f85d-2d48-42ec-8e93-4e266b810c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f914dfd-348a-46f6-9e93-76aa1fba950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f914dfd-348a-46f6-9e93-76aa1fba950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef93444-9492-4dcc-a0ca-4f31a080f9c3', 'volume_name': 'volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505892fb-6409-4443-bd54-c039886d2f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505892fb-6409-4443-bd54-c039886d2f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d47bff5-3980-4980-a0a6-9b38ce40eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Volume fef93444-9492-4dcc-a0ca-4f31a080f9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3', 'volume_size': 1} Aug 25 06:56:33 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 1073741824" returned: 0 in 0.766s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:33 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 Aug 25 06:56:33 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:34 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" returned: 0 in 0.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-638995636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef93444-9492-4dcc-a0ca-4f31a080f9c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8716ca2b07ee41c588b3f9fb781d26d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:33Z,use_quota=True,user_id='16f57596417e4c23b727e3ad8be957ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Creating volume fef93444-9492-4dcc-a0ca-4f31a080f9c3 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:34 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d8449-5b7d-4061-bfc9-cc35b2df2c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:34 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 1073741824 Aug 25 06:56:34 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfebb872-8314-474c-9653-2c81e0b53f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:34 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Volume volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 (70428f04-a6d1-4ae0-a945-0bf57ccb6ba3): created successfully Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfebb872-8314-474c-9653-2c81e0b53f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Flow 'volume_create_manager' (ef83cef8-5db1-49e4-8cf0-cbd92102a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5110f9aa-bb0e-446e-853b-6923d0f4c9f3 tempest-GroupsTest-1329634696 None] Created volume successfully. Aug 25 06:56:34 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 1073741824" returned: 0 in 0.717s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:34 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 Aug 25 06:56:34 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:35 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3" returned: 0 in 0.427s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d47bff5-3980-4980-a0a6-9b38ce40eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d20cbf-25ce-4b39-9991-35bdb2be7b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:35 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Volume volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 (fef93444-9492-4dcc-a0ca-4f31a080f9c3): created successfully Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d20cbf-25ce-4b39-9991-35bdb2be7b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Flow 'volume_create_manager' (9d92b9d9-3b57-4eb4-bbc4-313e1f98939f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0ea7c5a9-c716-4b62-973a-c3e67f9c1ccf tempest-VolumesListTestJSON-175828512 None] Created volume successfully. Aug 25 06:56:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-824c00a5-2750-40d8-a361-18f4a6185563 tempest-GroupsTest-1329634696 None] Update group completed successfully. Aug 25 06:56:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5f14acc1-1e8d-4b8b-9b90-409cdf217f61 tempest-GroupsTest-1329634696 None] Update group completed successfully. Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-fef93444-9492-4dcc-a0ca-4f31a080f9c3-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-fef93444-9492-4dcc-a0ca-4f31a080f9c3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-quobyte-fef93444-9492-4dcc-a0ca-4f31a080f9c3" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-fef93444-9492-4dcc-a0ca-4f31a080f9c3" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[213aa0ab-27e4-4158-8bc1-e2fab19018b3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Acquiring lock "cinder-quobyte-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa8db3-b84f-4ded-8e6a-e8f11c40dc75]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:39 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 Aug 25 06:56:39 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:39 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 Aug 25 06:56:39 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:39 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3" returned: 0 in 0.599s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:39 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3 Aug 25 06:56:39 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:40 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" returned: 0 in 0.610s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:40 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3 Aug 25 06:56:40 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:40 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fef93444-9492-4dcc-a0ca-4f31a080f9c3" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-fef93444-9492-4dcc-a0ca-4f31a080f9c3" released by "delete_volume" :: held 1.131s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:40 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-70428f04-a6d1-4ae0-a945-0bf57ccb6ba3" released by "delete_volume" :: held 1.043s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Acquiring lock "cinder-quobyte-99697751-2d69-4f51-98d1-fe5c32b66940" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-99697751-2d69-4f51-98d1-fe5c32b66940" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Created reservations ['4659bfbe-524e-47f7-b2d6-21849a580d61', '06b242c2-6adf-4b18-944b-e04e880cc6ef', 'b3d0504a-c8b7-4513-9f1e-07f0cc7862ba', 'ebd98ba4-d036-4c3f-ab01-ebc6b37bf606'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b99977c-93ef-4c01-9f06-bd39843434f8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:40 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:40 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:40 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 Aug 25 06:56:40 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:40 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.358s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:40 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Deleted volume successfully. Aug 25 06:56:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-afe3ab05-66b9-4dc9-8268-e4a9cbfabf47 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-fef93444-9492-4dcc-a0ca-4f31a080f9c3-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:41 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940" returned: 0 in 0.549s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:41 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940 Aug 25 06:56:41 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:41 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-99697751-2d69-4f51-98d1-fe5c32b66940" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "cinder-quobyte-99697751-2d69-4f51-98d1-fe5c32b66940" released by "delete_volume" :: held 0.891s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Created reservations ['24f3f493-2d44-4791-b856-b8489b90bfd8'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:41 devstack cinder-volume[94487]: WARNING cinder.quota [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1281285445 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1281285445, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:41 devstack cinder-volume[94487]: WARNING cinder.quota [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1281285445 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1281285445, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Created reservations ['841fd98f-30e5-470f-93c0-112215468ba6', '149105c7-a7c6-4185-b3e6-9c5067b00c01', '103b78ff-f270-49e5-84e1-ca80754545a1', '097d2b4c-f449-46c2-afff-2d2580dfab75'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Created reservations ['c21ada16-032c-46aa-ac07-b30cdce55602', '368ab994-d2f1-49a2-be74-3f9d9647392a', '50a499da-4074-4b7d-8f36-79b29613424b', '770a3850-34dc-40d9-897a-820ba47400b1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-quobyte-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed567f5d-fd7b-4978-b01f-a8aee2615903]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:42 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:42 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:42 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 Aug 25 06:56:42 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:42 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f7d522d4-cdda-40f9-9efb-c70bcbb74a4e tempest-GroupsTest-1329634696 None] Delete group completed successfully. Aug 25 06:56:42 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" returned: 0 in 0.516s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:42 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8 Aug 25 06:56:42 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:42 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8" released by "delete_volume" :: held 0.934s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Created reservations ['b10701c2-9713-4bd6-9afe-bc1582f237cf', '3377ff08-c4e9-4726-b583-7f3eb117b0f0', '62db7046-aaea-48c4-a31e-53c900fc0ed4', '6509cfb5-9f66-4cb4-9c9e-2e3d6ba41473'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:43 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:43 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-14bdcc7a-ec1a-4185-adc0-7a193bc48e27-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "cinder-14bdcc7a-ec1a-4185-adc0-7a193bc48e27-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Acquiring lock "cinder-quobyte-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e38a6-e5c8-4c64-bba1-ab05ffa75731]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:43 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.636s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:43 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Deleted volume successfully. Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c8ed8472-758f-4bf0-8d82-88db28ac9c58 tempest-VolumesListTestJSON-175828512 None] Lock "cinder-4d9062d7-f4c4-49fb-b379-ff27d7c6e9e8-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:43 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 Aug 25 06:56:43 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:43 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" returned: 0 in 0.515s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:43 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27 Aug 25 06:56:43 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:44 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" returned: 0 in 0.298s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "cinder-quobyte-14bdcc7a-ec1a-4185-adc0-7a193bc48e27" released by "delete_volume" :: held 0.892s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Created reservations ['8d36f9b9-ee40-4f33-ab82-d358bd4e7025', 'e2456327-82f6-4f13-9ae2-6b74357ca076', '26e4ad9f-063a-4f4f-a30d-eddfa377a591', '0559368f-cafd-4450-adf2-2553a8fb2723'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:44 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:56:44 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:44 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Deleted volume successfully. Aug 25 06:56:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4858cf2e-7d32-42fd-8a33-63639e7095fd tempest-VolumesListTestJSON-175828512 None] Lock "cinder-14bdcc7a-ec1a-4185-adc0-7a193bc48e27-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:54 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=154,cinder:SELECT=128,cinder:DELETE=9,cinder:INSERT=41 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:54 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=126,cinder:INSERT=42,cinder:UPDATE=154,cinder:DELETE=11 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:00 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:57:00 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:01 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.349s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:57:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:57:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:57:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-1bf2cabb-bbaa-4ebe-8319-6d96f372cfde req-684c447d-ae71-4ac4-b35c-c73dfe003ec0 tempest-AttachVolumeNegativeTest-857282591 None] Terminate volume connection completed successfully. Aug 25 06:57:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-1bf2cabb-bbaa-4ebe-8319-6d96f372cfde req-684c447d-ae71-4ac4-b35c-c73dfe003ec0 tempest-AttachVolumeNegativeTest-857282591 None] Deleting attachment 322f5917-c58b-47e1-90f7-be62df4c2b19. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:57:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Flow 'volume_create_manager' (29d5aa1d-114f-467b-a6e3-ea1933ab84b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6acdb1-4d7c-40e9-8a8e-b9a9bdde1305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6acdb1-4d7c-40e9-8a8e-b9a9bdde1305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-768050489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a386eb7-c58f-4a38-9d5f-40772baa0937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dabb217abe24e2b973048f52450382a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:21Z,use_quota=True,user_id='0ebdb5bad3b9408489e0863d9bee8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5994ae4d-4f20-4190-ae56-64abc07b27c6),volume_type_id=5994ae4d-4f20-4190-ae56-64abc07b27c6)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe527ec-f7b3-42ea-8725-d1589c223b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe527ec-f7b3-42ea-8725-d1589c223b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9eb248-6f60-46b4-9895-9beb572a6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9eb248-6f60-46b4-9895-9beb572a6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a386eb7-c58f-4a38-9d5f-40772baa0937', 'volume_name': 'volume-9a386eb7-c58f-4a38-9d5f-40772baa0937', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b5e132-e095-4f38-85e8-6de76a31d281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b5e132-e095-4f38-85e8-6de76a31d281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dd3464-4c47-4923-9038-73adee2efea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Volume 9a386eb7-c58f-4a38-9d5f-40772baa0937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a386eb7-c58f-4a38-9d5f-40772baa0937', 'volume_size': 1} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-768050489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a386eb7-c58f-4a38-9d5f-40772baa0937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dabb217abe24e2b973048f52450382a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:21Z,use_quota=True,user_id='0ebdb5bad3b9408489e0863d9bee8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5994ae4d-4f20-4190-ae56-64abc07b27c6),volume_type_id=5994ae4d-4f20-4190-ae56-64abc07b27c6)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Creating volume 9a386eb7-c58f-4a38-9d5f-40772baa0937 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:21 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:21 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 1073741824 Aug 25 06:57:21 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:21 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 1073741824" returned: 0 in 0.726s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:21 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 Aug 25 06:57:21 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:22 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dd3464-4c47-4923-9038-73adee2efea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a386eb7-c58f-4a38-9d5f-40772baa0937', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92b3296-e2bc-4417-be94-d58fa18824f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:22 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Volume volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 (9a386eb7-c58f-4a38-9d5f-40772baa0937): created successfully Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92b3296-e2bc-4417-be94-d58fa18824f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Flow 'volume_create_manager' (29d5aa1d-114f-467b-a6e3-ea1933ab84b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6eaf6a40-d8a3-48af-8309-c7bf8b8d4792 tempest-VolumeTypesAccessTest-647369900 None] Created volume successfully. Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Acquiring lock "cinder-9a386eb7-c58f-4a38-9d5f-40772baa0937-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "cinder-9a386eb7-c58f-4a38-9d5f-40772baa0937-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Acquiring lock "cinder-quobyte-9a386eb7-c58f-4a38-9d5f-40772baa0937" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "cinder-quobyte-9a386eb7-c58f-4a38-9d5f-40772baa0937" acquired by "delete_volume" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a569952-fad6-4bf9-980c-c8d12c2914e1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 Aug 25 06:57:23 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:23 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937" returned: 0 in 0.667s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937 Aug 25 06:57:23 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:24 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a386eb7-c58f-4a38-9d5f-40772baa0937" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "cinder-quobyte-9a386eb7-c58f-4a38-9d5f-40772baa0937" released by "delete_volume" :: held 1.115s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:24 devstack cinder-volume[94487]: WARNING cinder.quota [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1446581595 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1446581595, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:57:24 devstack cinder-volume[94487]: WARNING cinder.quota [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1446581595 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1446581595, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Created reservations ['e0d75dab-29c7-4122-814e-ad06d129d68d', '2f3ed2aa-a94c-4a51-8b54-c15b86bf9a89', 'd377b784-4246-4fb9-8a84-54c0bfae51ee', '76f9b1ad-960d-44e8-ae9b-f071d6b4df89'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:24 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:57:24 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:24 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.334s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Deleted volume successfully. Aug 25 06:57:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9aeb27b8-0665-4124-a210-f247ca1f221d tempest-VolumeTypesAccessTest-647369900 None] Lock "cinder-9a386eb7-c58f-4a38-9d5f-40772baa0937-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:34 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:57:34 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Flow 'volume_create_manager' (ab3b3ad6-8b13-441a-8766-6bda34255bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8d493b-369a-42bd-ba05-2d4eef40db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8d493b-369a-42bd-ba05-2d4eef40db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1912102470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce74e478-fdeb-432d-b4c2-a18fd95776a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42441284546b493cabab68caf81d37bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:38Z,use_quota=True,user_id='616c83bb321f44e9a9031e896c56d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df6f4fa-e33f-4e74-9402-8a2534f1f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df6f4fa-e33f-4e74-9402-8a2534f1f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542ca35-d3d6-44cf-90ba-fabdacdd3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542ca35-d3d6-44cf-90ba-fabdacdd3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce74e478-fdeb-432d-b4c2-a18fd95776a9', 'volume_name': 'volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33985974-0568-4fc9-b7a2-92df2ce3fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33985974-0568-4fc9-b7a2-92df2ce3fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5140e8df-a911-49b0-81f2-5d20c2ae8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:38 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Volume ce74e478-fdeb-432d-b4c2-a18fd95776a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9', 'volume_size': 1} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1912102470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce74e478-fdeb-432d-b4c2-a18fd95776a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42441284546b493cabab68caf81d37bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:38Z,use_quota=True,user_id='616c83bb321f44e9a9031e896c56d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Creating volume ce74e478-fdeb-432d-b4c2-a18fd95776a9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:38 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:38 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 1073741824 Aug 25 06:57:38 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:39 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 1073741824" returned: 0 in 1.327s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:39 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 Aug 25 06:57:39 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (3d2a9a9f-a253-4931-980b-f96688aea598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe87e8d1-0185-43fa-9820-60b653d19dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe87e8d1-0185-43fa-9820-60b653d19dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1122494386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:40Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8808ae59-d546-40d8-b1d0-4828ff9032f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8808ae59-d546-40d8-b1d0-4828ff9032f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5946b24-cf1f-47cf-ae1b-e36922539719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5946b24-cf1f-47cf-ae1b-e36922539719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae', 'volume_name': 'volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b58b8d-0352-4c06-a4d1-0594b90a5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b58b8d-0352-4c06-a4d1-0594b90a5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce138709-7a06-48e5-831b-81379ed39096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:40 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Volume 01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae', 'volume_size': 1} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:40 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9" returned: 0 in 0.954s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1122494386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:40Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Creating volume 01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:40 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:41 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae 1073741824 Aug 25 06:57:41 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5140e8df-a911-49b0-81f2-5d20c2ae8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad496c5-b50a-49af-96b3-1a3da62fc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Volume volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 (ce74e478-fdeb-432d-b4c2-a18fd95776a9): created successfully Aug 25 06:57:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad496c5-b50a-49af-96b3-1a3da62fc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Flow 'volume_create_manager' (ab3b3ad6-8b13-441a-8766-6bda34255bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-87fa559a-bdc1-4206-a40a-829989662eb8 tempest-TestMinimumBasicScenario-1490712566 None] Created volume successfully. Aug 25 06:57:42 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae 1073741824" returned: 0 in 1.350s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:42 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae Aug 25 06:57:42 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:43 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" returned: 0 in 0.817s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce138709-7a06-48e5-831b-81379ed39096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cde1e0-c79d-4073-9f75-93488ecf0a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:43 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Volume volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae (01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae): created successfully Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cde1e0-c79d-4073-9f75-93488ecf0a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (3d2a9a9f-a253-4931-980b-f96688aea598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:43 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-03a47e21-6825-4db2-ab08-d2c5c778c141 tempest-VolumesListAdminTestJSON-223136641 None] Created volume successfully. Aug 25 06:57:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-49813f64-e903-4a44-addd-bf29eaaa52f9 req-96de2a76-79f3-4428-8c7e-54acda670aa7 tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-49813f64-e903-4a44-addd-bf29eaaa52f9 req-96de2a76-79f3-4428-8c7e-54acda670aa7 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-49813f64-e903-4a44-addd-bf29eaaa52f9 req-96de2a76-79f3-4428-8c7e-54acda670aa7 tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-49813f64-e903-4a44-addd-bf29eaaa52f9 req-96de2a76-79f3-4428-8c7e-54acda670aa7 tempest-TestMinimumBasicScenario-1490712566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba68e422-b234-4de1-801a-6bf2b5b7a9dc', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:57:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-49813f64-e903-4a44-addd-bf29eaaa52f9 req-96de2a76-79f3-4428-8c7e-54acda670aa7 tempest-TestMinimumBasicScenario-1490712566 None] attachment_update completed successfully. Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (4a62da3b-63eb-4ae7-914a-97452aa67e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bad819e-7354-423f-b8fb-1c89472e98fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bad819e-7354-423f-b8fb-1c89472e98fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037150938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc3ca5d-fe80-4d5a-abef-a8b8eb94194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:45Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9cef21-4125-4f35-89e6-9eb4f44bd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9cef21-4125-4f35-89e6-9eb4f44bd443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5279209-51b1-40ea-a9ca-13bdbaa50d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5279209-51b1-40ea-a9ca-13bdbaa50d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc3ca5d-fe80-4d5a-abef-a8b8eb94194f', 'volume_name': 'volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb288a5-d999-4eed-9078-fad290546129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb288a5-d999-4eed-9078-fad290546129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191044d9-d222-4672-aabe-657f40a74df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Volume adc3ca5d-fe80-4d5a-abef-a8b8eb94194f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f', 'volume_size': 1} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037150938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc3ca5d-fe80-4d5a-abef-a8b8eb94194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:45Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Creating volume adc3ca5d-fe80-4d5a-abef-a8b8eb94194f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:45 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:45 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f 1073741824 Aug 25 06:57:45 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:47 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f 1073741824" returned: 0 in 1.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:47 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f Aug 25 06:57:47 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (644b6613-49d6-4652-a77f-ba6c5c8633e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b9dc3c-86f2-4c8a-9427-f9dde4604633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b9dc3c-86f2-4c8a-9427-f9dde4604633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1697217225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380363ed-9c08-4c5e-ba5f-fe9522221ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:47Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63863603-7515-4944-9364-c847942b18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63863603-7515-4944-9364-c847942b18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb02dcd0-8c56-4b9c-afbc-1019b3f86778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb02dcd0-8c56-4b9c-afbc-1019b3f86778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380363ed-9c08-4c5e-ba5f-fe9522221ad0', 'volume_name': 'volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe30f0ff-3bd9-46b7-b42a-5f923c4ed256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe30f0ff-3bd9-46b7-b42a-5f923c4ed256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46457ee8-0044-479c-80d3-c8b7992217c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Volume 380363ed-9c08-4c5e-ba5f-fe9522221ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0', 'volume_size': 1} Aug 25 06:57:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:48 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" returned: 0 in 1.188s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.648s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1697217225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380363ed-9c08-4c5e-ba5f-fe9522221ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:47Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Creating volume 380363ed-9c08-4c5e-ba5f-fe9522221ad0 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:48 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191044d9-d222-4672-aabe-657f40a74df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:48 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 1073741824 Aug 25 06:57:48 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f570dca-5b6d-400b-8bf4-285603637564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Volume volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f (adc3ca5d-fe80-4d5a-abef-a8b8eb94194f): created successfully Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f570dca-5b6d-400b-8bf4-285603637564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (4a62da3b-63eb-4ae7-914a-97452aa67e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e8dfa20b-7dfa-4fa6-8729-d435460f7372 tempest-VolumesListAdminTestJSON-223136641 None] Created volume successfully. Aug 25 06:57:49 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 1073741824" returned: 0 in 1.225s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:49 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 Aug 25 06:57:49 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:50 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (2fdecdbf-0412-49de-b378-10ba3cc4eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14052de2-a9e9-4fed-acc7-4a4b0fbba14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0" returned: 0 in 0.992s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14052de2-a9e9-4fed-acc7-4a4b0fbba14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-645887678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d80f0fc-e2de-4da5-8f0f-0835de3569e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:51Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9399f-98b1-42f2-8bed-3fd393b83acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9399f-98b1-42f2-8bed-3fd393b83acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1642bbc9-e2ec-497a-86c0-ee0d2953314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1642bbc9-e2ec-497a-86c0-ee0d2953314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d80f0fc-e2de-4da5-8f0f-0835de3569e6', 'volume_name': 'volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0644a17-8314-48de-afe9-a44e6b74392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0644a17-8314-48de-afe9-a44e6b74392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a22424-b09f-4a4d-80c5-6824d4d691f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Volume 8d80f0fc-e2de-4da5-8f0f-0835de3569e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6', 'volume_size': 1} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-645887678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d80f0fc-e2de-4da5-8f0f-0835de3569e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6717440cea7b4599afb94eb07a40daad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:51Z,use_quota=True,user_id='bb76db1e5d6144319578fb75885af5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Creating volume 8d80f0fc-e2de-4da5-8f0f-0835de3569e6 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:50 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46457ee8-0044-479c-80d3-c8b7992217c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cf93a2-56f6-4b52-8cc3-1924c8ee8e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Volume volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 (380363ed-9c08-4c5e-ba5f-fe9522221ad0): created successfully Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cf93a2-56f6-4b52-8cc3-1924c8ee8e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:50 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 1073741824 Aug 25 06:57:50 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (644b6613-49d6-4652-a77f-ba6c5c8633e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c8a1a2fa-0495-456a-a992-e05c82e2afd5 tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:57:51 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 1073741824" returned: 0 in 0.680s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:51 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 Aug 25 06:57:51 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59200add-dfc4-4d67-a251-d4479db3e3c3 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0" by "attach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59200add-dfc4-4d67-a251-d4479db3e3c3 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0" acquired by "attach_volume" :: waited 0.065s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:52 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" returned: 0 in 0.639s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-59200add-dfc4-4d67-a251-d4479db3e3c3 tempest-VolumesActionsTest-1493997238 None] Attaching volume 380363ed-9c08-4c5e-ba5f-fe9522221ad0 to instance 37dd2560-43c5-4da6-a5e4-7ac3a6c6336f at mountpoint /dev/vdb on host None. Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a22424-b09f-4a4d-80c5-6824d4d691f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a471427c-c627-476d-bb8e-5c745345e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Volume volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 (8d80f0fc-e2de-4da5-8f0f-0835de3569e6): created successfully Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a471427c-c627-476d-bb8e-5c745345e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Flow 'volume_create_manager' (2fdecdbf-0412-49de-b378-10ba3cc4eafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-59200add-dfc4-4d67-a251-d4479db3e3c3 tempest-VolumesActionsTest-1493997238 None] Attach volume completed successfully. Aug 25 06:57:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fa54e421-864b-4451-8bb3-f87fe3d61188 tempest-VolumesListAdminTestJSON-223136641 None] Created volume successfully. Aug 25 06:57:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59200add-dfc4-4d67-a251-d4479db3e3c3 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0" released by "attach_volume" :: held 0.540s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Terminate volume connection completed successfully. Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" by "detach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Detaching volume 380363ed-9c08-4c5e-ba5f-fe9522221ad0 from instance 37dd2560-43c5-4da6-a5e4-7ac3a6c6336f. Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Flow 'volume_create_manager' (f8e1e6df-aef8-4172-86a6-4d0de2acdf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af23109-6d54-479b-8782-866f340e5c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Detach volume completed successfully. Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af23109-6d54-479b-8782-866f340e5c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa294f4-d165-4e28-85ce-249c46e68c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836c6b9bb8ff4927a1f4a808ad40e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:54Z,use_quota=True,user_id='95e2b1d74c3c4764b1413bced77ffa1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba1448f-b5d8-4f3f-903c-f3da1681de07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba1448f-b5d8-4f3f-903c-f3da1681de07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6b6ed-f30a-47b8-97f3-d559f7020c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6b6ed-f30a-47b8-97f3-d559f7020c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa294f4-d165-4e28-85ce-249c46e68c45', 'volume_name': 'volume-cfa294f4-d165-4e28-85ce-249c46e68c45', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af7808-d2f8-4a41-a15b-f7c9a46fb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af7808-d2f8-4a41-a15b-f7c9a46fb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861ac857-32ec-4e5b-bc5f-15ead41ceb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Volume cfa294f4-d165-4e28-85ce-249c46e68c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa294f4-d165-4e28-85ce-249c46e68c45', 'volume_size': 1} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa294f4-d165-4e28-85ce-249c46e68c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836c6b9bb8ff4927a1f4a808ad40e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:54Z,use_quota=True,user_id='95e2b1d74c3c4764b1413bced77ffa1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Creating volume cfa294f4-d165-4e28-85ce-249c46e68c45 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:54 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1455a6b6-082b-445b-abfe-dcc434c1a9e9 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" released by "detach_volume" :: held 0.316s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:54 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 1073741824 Aug 25 06:57:54 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-376a1457-1589-42bb-b55c-e6e20b3bb737 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" by "detach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-376a1457-1589-42bb-b55c-e6e20b3bb737 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-376a1457-1589-42bb-b55c-e6e20b3bb737 tempest-VolumesActionsTest-1493997238 None] Volume detach called, but volume not attached. Aug 25 06:57:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-376a1457-1589-42bb-b55c-e6e20b3bb737 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:55 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 1073741824" returned: 0 in 1.003s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-quobyte-380363ed-9c08-4c5e-ba5f-fe9522221ad0" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:55 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 Aug 25 06:57:55 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "cinder-quobyte-380363ed-9c08-4c5e-ba5f-fe9522221ad0" acquired by "delete_volume" :: waited 0.067s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d29efa-0f5f-431f-8523-9ba65ba93d57]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:55 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 Aug 25 06:57:55 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:55 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45" returned: 0 in 0.495s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861ac857-32ec-4e5b-bc5f-15ead41ceb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa294f4-d165-4e28-85ce-249c46e68c45', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffdb891-ec9c-4ab7-b0cd-ab2a7705486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:55 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Volume volume-cfa294f4-d165-4e28-85ce-249c46e68c45 (cfa294f4-d165-4e28-85ce-249c46e68c45): created successfully Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffdb891-ec9c-4ab7-b0cd-ab2a7705486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Flow 'volume_create_manager' (f8e1e6df-aef8-4172-86a6-4d0de2acdf4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6569d8e5-be26-4fe4-8e92-d09df1b67d06 tempest-VolumesListAdminTestJSON-1874990620 None] Created volume successfully. Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Acquiring lock "cinder-cfa294f4-d165-4e28-85ce-249c46e68c45-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "cinder-cfa294f4-d165-4e28-85ce-249c46e68c45-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Acquiring lock "cinder-quobyte-cfa294f4-d165-4e28-85ce-249c46e68c45" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "cinder-quobyte-cfa294f4-d165-4e28-85ce-249c46e68c45" acquired by "delete_volume" :: waited 0.054s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[35347a36-9739-4eb8-88ab-6d1a5ca7d494]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:56 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0" returned: 0 in 1.385s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-8d80f0fc-e2de-4da5-8f0f-0835de3569e6-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:56 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0 Aug 25 06:57:56 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:56 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 Aug 25 06:57:56 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-8d80f0fc-e2de-4da5-8f0f-0835de3569e6-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-quobyte-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" acquired by "delete_volume" :: waited 0.058s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a463f-145d-49ea-a934-5b55dd132000]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:57 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-380363ed-9c08-4c5e-ba5f-fe9522221ad0" returned: 0 in 0.614s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "cinder-quobyte-380363ed-9c08-4c5e-ba5f-fe9522221ad0" released by "delete_volume" :: held 2.131s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:57 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 Aug 25 06:57:57 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Created reservations ['0269e193-f7b1-40b1-9957-86eae56d488c', '0cfc517a-a981-4e79-bd0a-3d31a593a314', 'aa9f106a-e077-4fb6-952a-7d077a648b0f', '91316e15-e6f7-4769-a011-e5bdfa4b18a4'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:57 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45" returned: 0 in 1.151s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:57 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45 Aug 25 06:57:57 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:58 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" returned: 0 in 0.818s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:58 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:57:58 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:58 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6 Aug 25 06:57:58 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:58 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cfa294f4-d165-4e28-85ce-249c46e68c45" returned: 0 in 0.605s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "cinder-quobyte-cfa294f4-d165-4e28-85ce-249c46e68c45" released by "delete_volume" :: held 1.918s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:58 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.621s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Created reservations ['8817d177-2172-46a6-b288-5679a151ae4e', 'dffc73d5-be5c-427b-8c60-cc69e3eabd3e', '5b8c8198-07e2-46af-838c-10fbd31a4760', 'fa12148d-7a34-4218-8fb3-3353bd1ccfe2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Deleted volume successfully. Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-02ccab77-bfb8-46c7-9f1b-d83389d3c1ba tempest-VolumesActionsTest-1493997238 None] Lock "cinder-380363ed-9c08-4c5e-ba5f-fe9522221ad0-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:58 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:57:58 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:59 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" returned: 0 in 1.145s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:59 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.467s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-8d80f0fc-e2de-4da5-8f0f-0835de3569e6" released by "delete_volume" :: held 2.159s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Deleted volume successfully. Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4703c06b-d5e1-4d01-9aa1-52522799479e tempest-VolumesListAdminTestJSON-1874990620 None] Lock "cinder-cfa294f4-d165-4e28-85ce-249c46e68c45-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Created reservations ['bb5363fa-d97d-4375-8024-34f63941f3b5', 'cbba8ff6-14db-45fd-beb8-34e760b30ee9', '6cbb8b9a-c072-4269-a965-92f44b33b841', '32dd020c-53ee-4036-90c7-e3d75ff0203e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:59 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:57:59 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:00 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.419s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Deleted volume successfully. Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e21bf9ed-42ee-4fbd-b98a-28f4ad12db83 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-8d80f0fc-e2de-4da5-8f0f-0835de3569e6-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:00 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:00 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-quobyte-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" acquired by "delete_volume" :: waited 0.076s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8480fedb-0353-4c25-a552-87462533be57]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:01 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.575s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:58:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:58:01 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f Aug 25 06:58:01 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:02 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" returned: 0 in 0.776s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:02 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f Aug 25 06:58:02 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:02 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" returned: 0 in 0.576s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f" released by "delete_volume" :: held 1.464s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Created reservations ['b73d95b4-f34d-4e47-b300-5dcd440daa9f', 'bf567aca-5d7f-48c7-b78f-57fc9cbcd984', 'c41c92b2-dd48-46d1-bb72-e09224826318', 'a0db0a5c-6636-445f-86e9-4a87b5f8b27a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:02 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:02 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:03 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Deleted volume successfully. Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e754c3c-a3d7-49e0-bc46-32b1ec35fb69 tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-adc3ca5d-fe80-4d5a-abef-a8b8eb94194f-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "cinder-quobyte-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebc742a-f8b3-42b2-adde-44da55516ca7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:04 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae Aug 25 06:58:04 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:04 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:04 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae Aug 25 06:58:04 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:04 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" returned: 0 in 0.310s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-quobyte-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae" released by "delete_volume" :: held 0.782s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Created reservations ['6bda7538-e508-4614-8da9-d43518e99835', '7dc30417-0d51-4d1f-a27e-42c31bb34c0a', 'f8ef7393-d5f4-491b-85e8-3e2ac9d4172b', 'e4b0be51-4fdd-4e76-9d9d-9bf275c9bdd5'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:05 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:05 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:05 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.846s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:05 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Deleted volume successfully. Aug 25 06:58:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13f799d4-6cdd-409c-be4c-e50fba80ff5c tempest-VolumesListAdminTestJSON-223136641 None] Lock "cinder-01aad1c7-88c3-4dcc-a07b-b47b8f3f79ae-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (36f6e56c-30a7-48db-85b4-9a4bc3cfe49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed92c7f-caa1-4f18-a527-fd323b00b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed92c7f-caa1-4f18-a527-fd323b00b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-51977399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ee09f-2990-407a-bc3f-feeba40697d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:06Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3132729-e367-4954-8c21-c2ea63bf4379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3132729-e367-4954-8c21-c2ea63bf4379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d38c710-7da3-4596-82a2-7dfada905563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d38c710-7da3-4596-82a2-7dfada905563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42ee09f-2990-407a-bc3f-feeba40697d7', 'volume_name': 'volume-d42ee09f-2990-407a-bc3f-feeba40697d7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726512d9-764b-4815-8212-79f62a780377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726512d9-764b-4815-8212-79f62a780377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c447d1a4-4de8-4e04-9799-8190e572d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Volume d42ee09f-2990-407a-bc3f-feeba40697d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42ee09f-2990-407a-bc3f-feeba40697d7', 'volume_size': 1} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-51977399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ee09f-2990-407a-bc3f-feeba40697d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:06Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Creating volume d42ee09f-2990-407a-bc3f-feeba40697d7 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:06 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:06 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 1073741824 Aug 25 06:58:06 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:07 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 1073741824" returned: 0 in 0.708s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:07 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 Aug 25 06:58:07 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:07 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c447d1a4-4de8-4e04-9799-8190e572d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42ee09f-2990-407a-bc3f-feeba40697d7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82e4b0a-40ac-400c-8b22-2c01dc33eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:07 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Volume volume-d42ee09f-2990-407a-bc3f-feeba40697d7 (d42ee09f-2990-407a-bc3f-feeba40697d7): created successfully Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82e4b0a-40ac-400c-8b22-2c01dc33eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (36f6e56c-30a7-48db-85b4-9a4bc3cfe49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9c8e4c5e-588a-4ebc-a376-55fbf274aa4b tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-d42ee09f-2990-407a-bc3f-feeba40697d7-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d42ee09f-2990-407a-bc3f-feeba40697d7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-quobyte-d42ee09f-2990-407a-bc3f-feeba40697d7" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d42ee09f-2990-407a-bc3f-feeba40697d7" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab54065-c0f3-4839-b12b-b610a7362bcd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:08 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 Aug 25 06:58:08 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:08 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7" returned: 0 in 0.380s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:08 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7 Aug 25 06:58:08 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:08 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d42ee09f-2990-407a-bc3f-feeba40697d7" returned: 0 in 0.263s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d42ee09f-2990-407a-bc3f-feeba40697d7" released by "delete_volume" :: held 0.695s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:08 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Created reservations ['f9c827d0-b760-498a-9088-91b1b8b98327', '140cd178-2089-41b6-bd1c-335ca29b482c', '55fc9552-5241-4892-9574-a62096d003a1', '0078ca76-4d67-449f-a580-5cf43b228684'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:09 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:09 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:09 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Deleted volume successfully. Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c122373-bd72-4195-a225-f3279076a6e2 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d42ee09f-2990-407a-bc3f-feeba40697d7-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (887cb535-a658-444e-ab60-67a97210ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ad4e0b-b6b2-48e5-abac-430923a2e48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ad4e0b-b6b2-48e5-abac-430923a2e48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-146066752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef314e-c497-43e9-8c07-f8e93948acb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:10Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28203198-1d0f-44b5-b5e8-911467deb068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28203198-1d0f-44b5-b5e8-911467deb068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0c2e5-e757-42d4-bd3d-3a3ffa26684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0c2e5-e757-42d4-bd3d-3a3ffa26684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ef314e-c497-43e9-8c07-f8e93948acb9', 'volume_name': 'volume-d9ef314e-c497-43e9-8c07-f8e93948acb9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c594a-0379-4960-ba32-6a55e704f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c594a-0379-4960-ba32-6a55e704f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42935ec-4240-4a12-b105-1afbbab52843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:09 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Volume d9ef314e-c497-43e9-8c07-f8e93948acb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ef314e-c497-43e9-8c07-f8e93948acb9', 'volume_size': 1} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-146066752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef314e-c497-43e9-8c07-f8e93948acb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:10Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Creating volume d9ef314e-c497-43e9-8c07-f8e93948acb9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:09 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:09 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 1073741824 Aug 25 06:58:09 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:10 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 1073741824" returned: 0 in 0.476s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:10 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 Aug 25 06:58:10 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:10 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9" returned: 0 in 0.256s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42935ec-4240-4a12-b105-1afbbab52843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ef314e-c497-43e9-8c07-f8e93948acb9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6484362-57f8-4344-accf-4b6df23d0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:10 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Volume volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 (d9ef314e-c497-43e9-8c07-f8e93948acb9): created successfully Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6484362-57f8-4344-accf-4b6df23d0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (887cb535-a658-444e-ab60-67a97210ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4da211ac-66c5-4be2-9a77-9a76e90c6075 tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:58:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-d9ef314e-c497-43e9-8c07-f8e93948acb9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d9ef314e-c497-43e9-8c07-f8e93948acb9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-quobyte-d9ef314e-c497-43e9-8c07-f8e93948acb9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d9ef314e-c497-43e9-8c07-f8e93948acb9" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3b6d11-57dd-4403-943a-0ca0db72c96e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:11 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 Aug 25 06:58:11 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:11 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9" returned: 0 in 0.456s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:11 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9 Aug 25 06:58:11 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:11 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d9ef314e-c497-43e9-8c07-f8e93948acb9" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d9ef314e-c497-43e9-8c07-f8e93948acb9" released by "delete_volume" :: held 0.770s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Created reservations ['6fb5e1e5-31e6-420b-b814-a97b63efec70', '1435a953-bb48-4171-8b03-9c4c5dd2f6fa', '3658e3f3-f1b8-4a96-b321-0d6dde03c621', 'f3388532-19c8-4a21-aadc-1b83e8cec20c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:11 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:11 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:12 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.244s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:12 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Deleted volume successfully. Aug 25 06:58:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab06975b-1294-417d-869f-b02d85af1027 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d9ef314e-c497-43e9-8c07-f8e93948acb9-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (a003c510-1a28-405a-a142-2f38a9bf97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b3650-84ba-429d-aeab-a9d599a11bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b3650-84ba-429d-aeab-a9d599a11bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215214615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10baafef-f605-4048-b92d-ac9f3a8ab7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:13Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27e5b35-1d3a-4c14-b992-7b060bf619a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27e5b35-1d3a-4c14-b992-7b060bf619a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c4010-a7c3-4841-9b63-1ecea025ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c4010-a7c3-4841-9b63-1ecea025ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10baafef-f605-4048-b92d-ac9f3a8ab7a1', 'volume_name': 'volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94576767-5348-493c-aeeb-70c42e45f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94576767-5348-493c-aeeb-70c42e45f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6fa3b-f257-4b05-9a82-dec2ac3ffe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Volume 10baafef-f605-4048-b92d-ac9f3a8ab7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1', 'volume_size': 1} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215214615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10baafef-f605-4048-b92d-ac9f3a8ab7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:13Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Creating volume 10baafef-f605-4048-b92d-ac9f3a8ab7a1 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:13 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:13 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 1073741824 Aug 25 06:58:13 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:13 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 1073741824" returned: 0 in 0.498s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:13 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 Aug 25 06:58:13 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:13 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1" returned: 0 in 0.336s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6fa3b-f257-4b05-9a82-dec2ac3ffe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b8b09-bdf0-44a6-993d-fa0244a096e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Volume volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 (10baafef-f605-4048-b92d-ac9f3a8ab7a1): created successfully Aug 25 06:58:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b8b09-bdf0-44a6-993d-fa0244a096e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (a003c510-1a28-405a-a142-2f38a9bf97a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c16b2ac7-16fa-40d0-9929-b92dbcae7fa6 tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-10baafef-f605-4048-b92d-ac9f3a8ab7a1-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-10baafef-f605-4048-b92d-ac9f3a8ab7a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-quobyte-10baafef-f605-4048-b92d-ac9f3a8ab7a1" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-10baafef-f605-4048-b92d-ac9f3a8ab7a1" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f311e-8a14-44b1-9a7c-7e056d6d6244]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:15 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 Aug 25 06:58:15 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:15 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1" returned: 0 in 0.442s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:15 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1 Aug 25 06:58:15 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:15 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Flow 'volume_create_manager' (5a47664c-1c0e-4063-b622-f63222e91615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce3d6f4-ed24-4f05-a450-60267fb77d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce3d6f4-ed24-4f05-a450-60267fb77d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1982382161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a7d79e-d8e6-49f2-8912-4acaa311fedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b52eda731a543059175955a64eaf353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:16Z,use_quota=True,user_id='4a723261b51943a089cca88439793c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6086c95-3f48-4fba-8e17-074b2f7bc3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6086c95-3f48-4fba-8e17-074b2f7bc3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90835a54-02e5-4158-a45c-2f0fea2b2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90835a54-02e5-4158-a45c-2f0fea2b2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a7d79e-d8e6-49f2-8912-4acaa311fedf', 'volume_name': 'volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b293ec-cbdc-4e20-a2ce-5269b57f0467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b293ec-cbdc-4e20-a2ce-5269b57f0467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd94331-a881-480c-ba14-07bb1407776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Volume 46a7d79e-d8e6-49f2-8912-4acaa311fedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf', 'volume_size': 1} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1982382161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a7d79e-d8e6-49f2-8912-4acaa311fedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b52eda731a543059175955a64eaf353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:16Z,use_quota=True,user_id='4a723261b51943a089cca88439793c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Creating volume 46a7d79e-d8e6-49f2-8912-4acaa311fedf {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:16 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:16 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf 1073741824 Aug 25 06:58:16 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:16 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10baafef-f605-4048-b92d-ac9f3a8ab7a1" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-10baafef-f605-4048-b92d-ac9f3a8ab7a1" released by "delete_volume" :: held 0.784s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Created reservations ['1f83f731-a6c7-44c9-8f6a-0fa01ed87b03', '01b70a81-e466-4507-899b-03acb8a2482f', 'f4751c0b-dd3c-4753-9361-4edb2ee6dea1', 'a13de791-2227-4f76-9b2c-3193f0396545'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:16 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:16 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:16 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.263s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:16 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Deleted volume successfully. Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf 1073741824" returned: 0 in 0.479s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0864e7ba-d074-4a56-92a9-7b9981e9b7d8 tempest-VolumesActionsTest-1015513234 None] Lock "cinder-10baafef-f605-4048-b92d-ac9f3a8ab7a1-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:16 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf Aug 25 06:58:16 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:16 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf" returned: 0 in 0.325s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd94331-a881-480c-ba14-07bb1407776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf959b6-65df-4e34-8da4-21114ebc7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Volume volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf (46a7d79e-d8e6-49f2-8912-4acaa311fedf): created successfully Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf959b6-65df-4e34-8da4-21114ebc7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Flow 'volume_create_manager' (5a47664c-1c0e-4063-b622-f63222e91615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-46c1a797-4810-406a-a60c-0e22e20b7b48 tempest-VolumesMetadataTest-14668559 None] Created volume successfully. Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (b9d11cdc-9c50-424e-aabb-4e416f77d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604f3a99-154c-4afd-b2c0-977932e33e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604f3a99-154c-4afd-b2c0-977932e33e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1775315857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1130a34-22ef-43e4-95fe-2e4dda10ef1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:17Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386ef3cd-528e-466d-9ba6-4b5301b855e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386ef3cd-528e-466d-9ba6-4b5301b855e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f5c167-4ee3-4d24-ad36-0afda009a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f5c167-4ee3-4d24-ad36-0afda009a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1130a34-22ef-43e4-95fe-2e4dda10ef1a', 'volume_name': 'volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af3268-4132-479d-a9ae-4824d555b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af3268-4132-479d-a9ae-4824d555b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aec76b0-a9dd-48cf-9c38-c70ce75d6d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Volume d1130a34-22ef-43e4-95fe-2e4dda10ef1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a', 'volume_size': 1} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1775315857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1130a34-22ef-43e4-95fe-2e4dda10ef1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:17Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Creating volume d1130a34-22ef-43e4-95fe-2e4dda10ef1a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:17 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:17 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a 1073741824 Aug 25 06:58:17 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:17 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a 1073741824" returned: 0 in 0.426s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:17 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a Aug 25 06:58:17 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:17 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" returned: 0 in 0.246s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aec76b0-a9dd-48cf-9c38-c70ce75d6d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f250b357-9cb9-4756-ab92-e8737cd81fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Volume volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a (d1130a34-22ef-43e4-95fe-2e4dda10ef1a): created successfully Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f250b357-9cb9-4756-ab92-e8737cd81fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (b9d11cdc-9c50-424e-aabb-4e416f77d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c0be5409-3921-4d21-839f-bcfa52057b2b tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-d1130a34-22ef-43e4-95fe-2e4dda10ef1a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d1130a34-22ef-43e4-95fe-2e4dda10ef1a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Acquiring lock "cinder-quobyte-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8cb86e-756a-40ee-bec4-076578ea2014]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a Aug 25 06:58:18 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" returned: 0 in 0.506s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a Aug 25 06:58:18 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (23232ce0-342e-4fa6-9148-080512e55a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a5dd65-c1e6-4143-a9fd-0778bf55c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a5dd65-c1e6-4143-a9fd-0778bf55c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-176812906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a85a3df-5ac6-4e05-8971-0a33db1db679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:19Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82990df0-229c-497d-bacf-3af9bf85cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82990df0-229c-497d-bacf-3af9bf85cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7186531-847c-4e41-8a4f-bced004a0ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7186531-847c-4e41-8a4f-bced004a0ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a85a3df-5ac6-4e05-8971-0a33db1db679', 'volume_name': 'volume-9a85a3df-5ac6-4e05-8971-0a33db1db679', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824233f2-b810-4431-83dd-c5b37695bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824233f2-b810-4431-83dd-c5b37695bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5079c51-14b1-4496-8606-1e6c1f68cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Volume 9a85a3df-5ac6-4e05-8971-0a33db1db679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a85a3df-5ac6-4e05-8971-0a33db1db679', 'volume_size': 1} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-176812906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a85a3df-5ac6-4e05-8971-0a33db1db679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:19Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Creating volume 9a85a3df-5ac6-4e05-8971-0a33db1db679 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:19 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 1073741824 Aug 25 06:58:19 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Acquiring lock "cinder-46a7d79e-d8e6-49f2-8912-4acaa311fedf-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "cinder-46a7d79e-d8e6-49f2-8912-4acaa311fedf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Acquiring lock "cinder-quobyte-46a7d79e-d8e6-49f2-8912-4acaa311fedf" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "cinder-quobyte-46a7d79e-d8e6-49f2-8912-4acaa311fedf" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:19 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" returned: 0 in 0.402s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[788220b7-6af8-42cc-8e38-b9606bdf4c41]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "cinder-quobyte-d1130a34-22ef-43e4-95fe-2e4dda10ef1a" released by "delete_volume" :: held 0.979s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Created reservations ['e4da98ed-ab0f-472a-b95b-819c37ad0e43', '89c5881c-0d61-4792-b20b-1e5dc4e220d0', '45d134d2-7e3b-4433-a4d0-c28d8e43ba3c', 'a24d84a7-d2d1-41aa-a57c-b41ba2caeeee'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:19 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf Aug 25 06:58:19 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 1073741824" returned: 0 in 0.707s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 Aug 25 06:58:19 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.461s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Deleted volume successfully. Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-26a30219-93cd-4386-8dba-8273c09a915b tempest-VolumesActionsTest-1015513234 None] Lock "cinder-d1130a34-22ef-43e4-95fe-2e4dda10ef1a-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:20 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf" returned: 0 in 0.755s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:20 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf Aug 25 06:58:20 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:20 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679" returned: 0 in 0.488s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5079c51-14b1-4496-8606-1e6c1f68cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a85a3df-5ac6-4e05-8971-0a33db1db679', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdd611f-09c6-4f15-ba98-b4ab7a812bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Volume volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 (9a85a3df-5ac6-4e05-8971-0a33db1db679): created successfully Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdd611f-09c6-4f15-ba98-b4ab7a812bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (23232ce0-342e-4fa6-9148-080512e55a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-30676535-65fa-4542-b764-f0049f60e8af tempest-AttachVolumeNegativeTest-857282591 None] Created volume successfully. Aug 25 06:58:20 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-46a7d79e-d8e6-49f2-8912-4acaa311fedf" returned: 0 in 0.470s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "cinder-quobyte-46a7d79e-d8e6-49f2-8912-4acaa311fedf" released by "delete_volume" :: held 1.288s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Created reservations ['ccf3f8bc-5c24-498a-a7c2-9f3c8d75944b', '16707d01-f1c2-4ca3-81af-98c1cf0b1eed', 'cd8f83a8-b4cb-4a21-9b87-b01be0c55349', '398d758b-7ad4-4d73-9d78-f8757c8c11e2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (6161ab54-d996-45f7-a0fb-589aebfa96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eae675-42c0-43b5-8008-2b1618e49900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eae675-42c0-43b5-8008-2b1618e49900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738805958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdea9e5f-2a6a-461b-9aad-e38d2f7c0492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:21Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43fc220-218d-4224-ae52-6dfd166867b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43fc220-218d-4224-ae52-6dfd166867b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf061f8a-ecfd-4ca2-8f54-c94eeb250143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf061f8a-ecfd-4ca2-8f54-c94eeb250143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdea9e5f-2a6a-461b-9aad-e38d2f7c0492', 'volume_name': 'volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88583410-6f79-4849-880c-1b640a3a6b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88583410-6f79-4849-880c-1b640a3a6b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79ff719-f070-4bb3-8e86-7cfd7672f75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Volume fdea9e5f-2a6a-461b-9aad-e38d2f7c0492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492', 'volume_size': 1} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738805958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdea9e5f-2a6a-461b-9aad-e38d2f7c0492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c07a164899423296facf4c17a4f71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:21Z,use_quota=True,user_id='17972f7161d04ab9a55a60546362a411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Creating volume fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:20 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:20 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 1073741824 Aug 25 06:58:20 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:20 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:20 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:21 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.387s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Deleted volume successfully. Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6ed69e5-293e-484a-a284-8e8b2e67ec7a tempest-VolumesMetadataTest-14668559 None] Lock "cinder-46a7d79e-d8e6-49f2-8912-4acaa311fedf-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:21 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 1073741824" returned: 0 in 0.604s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:21 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 Aug 25 06:58:21 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:21 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" returned: 0 in 0.404s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79ff719-f070-4bb3-8e86-7cfd7672f75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1330b86-ba86-49ab-b70b-75571d66a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Volume volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 (fdea9e5f-2a6a-461b-9aad-e38d2f7c0492): created successfully Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1330b86-ba86-49ab-b70b-75571d66a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Flow 'volume_create_manager' (6161ab54-d996-45f7-a0fb-589aebfa96d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-15e76cc4-4c17-4889-9928-a0b74c34fb13 tempest-VolumesActionsTest-1493997238 None] Created volume successfully. Aug 25 06:58:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a436ef5a-ea3b-4a2e-ab96-4367556997c2 req-cc7c8712-8655-43f2-8c48-5b1210dc00bf tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a436ef5a-ea3b-4a2e-ab96-4367556997c2 req-cc7c8712-8655-43f2-8c48-5b1210dc00bf tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a436ef5a-ea3b-4a2e-ab96-4367556997c2 req-cc7c8712-8655-43f2-8c48-5b1210dc00bf tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-a436ef5a-ea3b-4a2e-ab96-4367556997c2 req-cc7c8712-8655-43f2-8c48-5b1210dc00bf tempest-AttachVolumeNegativeTest-857282591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-9a85a3df-5ac6-4e05-8971-0a33db1db679', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '970a77a7-3f2a-4f4b-9881-d2888f3b50e8', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:58:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-a436ef5a-ea3b-4a2e-ab96-4367556997c2 req-cc7c8712-8655-43f2-8c48-5b1210dc00bf tempest-AttachVolumeNegativeTest-857282591 None] attachment_update completed successfully. Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "cinder-quobyte-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-quobyte-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[63872f83-e4f8-4cf6-8101-3c422409284f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:23 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 Aug 25 06:58:23 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:24 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" returned: 0 in 0.416s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:24 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492 Aug 25 06:58:24 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:24 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-quobyte-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492" released by "delete_volume" :: held 0.806s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Created reservations ['d81ff167-e650-46be-bbad-6a676bd6d09a', 'ced36d44-8389-4dc9-88f2-fa1c9c9ae935', '800af491-8eca-47d9-a389-345cc1a70c72', '3398f152-745e-4b94-87b2-ecc12b4eaf66'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:24 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:24 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:25 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.405s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Deleted volume successfully. Aug 25 06:58:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-320f3001-1c39-4863-9da3-8a48f133acc2 tempest-VolumesActionsTest-1493997238 None] Lock "cinder-fdea9e5f-2a6a-461b-9aad-e38d2f7c0492-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-9fa941ee-0c02-489a-82a0-74a66dc01a90 req-8aeee116-5d09-4a91-999c-b6b1dbccb29d tempest-AttachVolumeNegativeTest-857282591 None] Terminate volume connection completed successfully. Aug 25 06:58:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-9fa941ee-0c02-489a-82a0-74a66dc01a90 req-8aeee116-5d09-4a91-999c-b6b1dbccb29d tempest-AttachVolumeNegativeTest-857282591 None] Deleting attachment 970a77a7-3f2a-4f4b-9881-d2888f3b50e8. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Flow 'volume_create_manager' (8f5f3a0b-d7b5-484e-a7e7-001651b54914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a1d06-5fa8-49c9-9dcf-12b48d448396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a1d06-5fa8-49c9-9dcf-12b48d448396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1401615201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b161d6-df1c-48a9-ae78-29ad6d1d3bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32f54ff5f3944c4a219bdb881e02961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:28Z,use_quota=True,user_id='d5df5aa3742242979cf6b186da8de19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea676d10-22ab-4445-8200-16ac395fdb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea676d10-22ab-4445-8200-16ac395fdb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc2871b-6d3a-4ecd-9b39-ee53696143f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc2871b-6d3a-4ecd-9b39-ee53696143f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b161d6-df1c-48a9-ae78-29ad6d1d3bf4', 'volume_name': 'volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77897583-0d5c-410c-8bb1-c19dc445118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77897583-0d5c-410c-8bb1-c19dc445118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dfc62b-2ad7-4939-aa81-447ad0049d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Volume 56b161d6-df1c-48a9-ae78-29ad6d1d3bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4', 'volume_size': 1} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1401615201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b161d6-df1c-48a9-ae78-29ad6d1d3bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32f54ff5f3944c4a219bdb881e02961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:28Z,use_quota=True,user_id='d5df5aa3742242979cf6b186da8de19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Creating volume 56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:28 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:28 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 1073741824 Aug 25 06:58:28 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:29 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 1073741824" returned: 0 in 0.796s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:29 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 Aug 25 06:58:29 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:29 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dfc62b-2ad7-4939-aa81-447ad0049d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0baa555-3005-4bec-846c-bfb7da3fabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:29 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Volume volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 (56b161d6-df1c-48a9-ae78-29ad6d1d3bf4): created successfully Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0baa555-3005-4bec-846c-bfb7da3fabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Flow 'volume_create_manager' (8f5f3a0b-d7b5-484e-a7e7-001651b54914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-29c731b8-0473-4984-bfe6-4621ebf02442 tempest-VolumesTransfersTest-1403375436 None] Created volume successfully. Aug 25 06:58:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3630fc24-f2ee-4751-b0a2-199690b060e6 tempest-VolumesTransfersTest-1178476125 None] Transfer volume completed successfully. Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "cinder-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "cinder-quobyte-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-quobyte-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f00d0-7347-4dab-a691-418bc41f633e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:32 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 Aug 25 06:58:32 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:33 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" returned: 0 in 0.605s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:33 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4 Aug 25 06:58:33 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:33 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" returned: 0 in 0.365s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-quobyte-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4" released by "delete_volume" :: held 1.051s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Created reservations ['05ae5155-7be3-4635-b335-aa9f6546149e', '9fa77187-573d-409c-8bc7-fb967efbe4a4', 'a50db2d5-5024-4c2f-87f3-82c7faa50d21', '66362592-5bc2-4fdd-927a-6126f6467ab2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:33 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:33 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:34 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Deleted volume successfully. Aug 25 06:58:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-536b63c3-1645-4223-9860-939786e718e4 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-56b161d6-df1c-48a9-ae78-29ad6d1d3bf4-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:34 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=152,cinder:SELECT=113,cinder:INSERT=33,cinder:DELETE=9 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Flow 'volume_create_manager' (59f8f7c6-7071-4784-a967-b7ca3721b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50264610-b386-45b3-a905-ac1bcf8b0a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=109,cinder:UPDATE=138,cinder:DELETE=17,cinder:INSERT=31 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50264610-b386-45b3-a905-ac1bcf8b0a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-619252544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ed7da-3dcf-4a39-870a-e623edcbb0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32f54ff5f3944c4a219bdb881e02961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:35Z,use_quota=True,user_id='d5df5aa3742242979cf6b186da8de19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743bbd4-afdc-4f1a-9558-b083fdc11b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743bbd4-afdc-4f1a-9558-b083fdc11b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a671a34-bc14-4c06-977f-c1e9171a8737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a671a34-bc14-4c06-977f-c1e9171a8737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7ed7da-3dcf-4a39-870a-e623edcbb0d4', 'volume_name': 'volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1e90e-c17b-4149-8b99-5ad0ffbcc7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1e90e-c17b-4149-8b99-5ad0ffbcc7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d878c9a-5980-406a-a2cc-60718710c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:35 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Volume 2b7ed7da-3dcf-4a39-870a-e623edcbb0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4', 'volume_size': 1} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-619252544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ed7da-3dcf-4a39-870a-e623edcbb0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32f54ff5f3944c4a219bdb881e02961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:35Z,use_quota=True,user_id='d5df5aa3742242979cf6b186da8de19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Creating volume 2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:35 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:35 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 1073741824 Aug 25 06:58:35 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:36 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 1073741824" returned: 0 in 0.542s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:36 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 Aug 25 06:58:36 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:36 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" returned: 0 in 0.427s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d878c9a-5980-406a-a2cc-60718710c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56597828-6095-4b56-8431-041222465f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:36 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Volume volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 (2b7ed7da-3dcf-4a39-870a-e623edcbb0d4): created successfully Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56597828-6095-4b56-8431-041222465f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Flow 'volume_create_manager' (59f8f7c6-7071-4784-a967-b7ca3721b218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-49cc124b-13cc-47df-b9d3-01de31de06ed tempest-VolumesTransfersTest-1403375436 None] Created volume successfully. Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "cinder-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "cinder-quobyte-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-quobyte-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef8f0e-288f-467c-9da0-19e5fa2c8cae]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:38 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 Aug 25 06:58:38 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:38 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:39 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4 Aug 25 06:58:39 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:39 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" returned: 0 in 0.324s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-quobyte-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4" released by "delete_volume" :: held 0.979s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Created reservations ['e8bed7ec-7401-4d7c-94c1-7569e43fcbd6', 'a82e6b34-a972-4293-81a3-223fe382a919', 'b325b45c-0631-40c6-baaa-219db9f52ff8', 'cc571739-f503-430c-abca-2a1f243f3834'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:39 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:39 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:39 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Deleted volume successfully. Aug 25 06:58:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-30e9543d-9572-4129-8c65-05cca79ba4b3 tempest-VolumesTransfersTest-1632930546 None] Lock "cinder-2b7ed7da-3dcf-4a39-870a-e623edcbb0d4-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Flow 'volume_create_manager' (36f0d106-fc5e-41b5-a6b3-dd753db86e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45849aa2-9ae4-4285-a010-c02db0afa9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45849aa2-9ae4-4285-a010-c02db0afa9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2118815008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6c7821-0ff4-4a7b-a747-c56086b51fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b3ac7365454b29ae28e069d83015bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:44Z,use_quota=True,user_id='aabad2a9b91b46abbf22c39046204d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3b5a28-4c53-4b5f-805c-47e3c4acddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3b5a28-4c53-4b5f-805c-47e3c4acddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc5b87e-2f74-4f46-8ac9-8ef84d8c71e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc5b87e-2f74-4f46-8ac9-8ef84d8c71e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6c7821-0ff4-4a7b-a747-c56086b51fc3', 'volume_name': 'volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ef00d4-f933-49fa-9cbb-49044be035f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ef00d4-f933-49fa-9cbb-49044be035f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d65a8-de99-423e-a5fc-4f060fee9f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Volume dd6c7821-0ff4-4a7b-a747-c56086b51fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3', 'volume_size': 1} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2118815008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6c7821-0ff4-4a7b-a747-c56086b51fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b3ac7365454b29ae28e069d83015bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:44Z,use_quota=True,user_id='aabad2a9b91b46abbf22c39046204d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Creating volume dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:43 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:43 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 1073741824 Aug 25 06:58:43 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:44 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 1073741824" returned: 0 in 0.910s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:44 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 Aug 25 06:58:44 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:45 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d65a8-de99-423e-a5fc-4f060fee9f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5712cd-52e9-4041-b110-c3f61587a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Volume volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 (dd6c7821-0ff4-4a7b-a747-c56086b51fc3): created successfully Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5712cd-52e9-4041-b110-c3f61587a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Flow 'volume_create_manager' (36f0d106-fc5e-41b5-a6b3-dd753db86e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1eb9c4b2-9681-483f-b971-58cb9021ebfb tempest-SnapshotMetadataTestJSON-2140764535 None] Created volume successfully. Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Creating offline snapshot de138d0f-347b-4db0-8944-df73f2572e9c of volume dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bfbf65-8318-412d-b5ad-e267e521090a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 Aug 25 06:58:46 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:46 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" returned: 0 in 0.726s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:47 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c 1G Aug 25 06:58:47 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:47 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c 1G" returned: 0 in 0.838s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:47 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c Aug 25 06:58:47 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-2e87809f-4283-4efe-a048-f9da7649f9a2 req-b59cca93-1255-4065-a164-7ebdfddee9b5 tempest-TestMinimumBasicScenario-1490712566 None] Terminate volume connection completed successfully. Aug 25 06:58:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-2e87809f-4283-4efe-a048-f9da7649f9a2 req-b59cca93-1255-4065-a164-7ebdfddee9b5 tempest-TestMinimumBasicScenario-1490712566 None] Deleting attachment ba68e422-b234-4de1-801a-6bf2b5b7a9dc. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:58:48 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c" returned: 0 in 0.638s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:48 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c is being set with open permissions: ugo+rw Aug 25 06:58:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:48 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c Aug 25 06:58:48 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "cinder-ce74e478-fdeb-432d-b4c2-a18fd95776a9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "cinder-ce74e478-fdeb-432d-b4c2-a18fd95776a9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "cinder-quobyte-ce74e478-fdeb-432d-b4c2-a18fd95776a9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "cinder-quobyte-ce74e478-fdeb-432d-b4c2-a18fd95776a9" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:49 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf6bf74-c6cc-40a4-9743-227c97f31d32]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c" returned: 0 in 0.828s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info Aug 25 06:58:49 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 Aug 25 06:58:49 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info is being set with open permissions: ugo+rw Aug 25 06:58:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9" returned: 0 in 0.790s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info Aug 25 06:58:50 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:50 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9 Aug 25 06:58:50 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:50 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.info" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.362s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0e9be6e7-1791-4431-abee-6f8f0a614837 tempest-SnapshotMetadataTestJSON-2140764535 None] Create snapshot completed successfully Aug 25 06:58:50 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ce74e478-fdeb-432d-b4c2-a18fd95776a9" returned: 0 in 0.594s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "cinder-quobyte-ce74e478-fdeb-432d-b4c2-a18fd95776a9" released by "delete_volume" :: held 1.471s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Created reservations ['4f12836d-8b13-4e88-9f84-63741636641f', 'fa354596-f98c-414b-b721-c20192b88c6d', '01f906de-d407-4cbc-8abe-076afaada264', '3b9f03ac-2e87-4a35-ba89-dee5d072f655'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:50 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:51 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Deleted volume successfully. Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ace13457-5d33-400b-8102-1d426fdfd62b tempest-TestMinimumBasicScenario-1490712566 None] Lock "cinder-ce74e478-fdeb-432d-b4c2-a18fd95776a9-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Flow 'volume_create_manager' (6fe40ccb-4ee6-411c-a427-2f0c2b6cb2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4256f37f-a44c-4a3e-8a81-4fa49625d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4256f37f-a44c-4a3e-8a81-4fa49625d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1251491927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c45d66-8c4c-478e-b7af-5f637515e8cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61511e36ed2e49f4ab161f1662d97566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:51Z,use_quota=True,user_id='13b37e2b1604464d91ad7e75a9488b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5465e5-47fb-4452-b999-08745bd1f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5465e5-47fb-4452-b999-08745bd1f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb498f5-e45a-4a0d-b072-d41c602a206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb498f5-e45a-4a0d-b072-d41c602a206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'volume_name': 'volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3521f-be70-4d88-a99b-c2fcf73391ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3521f-be70-4d88-a99b-c2fcf73391ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963c996b-148e-4e26-b769-430edb8f382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Volume e5c45d66-8c4c-478e-b7af-5f637515e8cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'volume_size': 1} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1251491927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c45d66-8c4c-478e-b7af-5f637515e8cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61511e36ed2e49f4ab161f1662d97566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:51Z,use_quota=True,user_id='13b37e2b1604464d91ad7e75a9488b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Creating volume e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:58:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:51 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf 1073741824 Aug 25 06:58:51 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:52 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf 1073741824" returned: 0 in 0.714s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:52 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:58:52 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "cinder-de138d0f-347b-4db0-8944-df73f2572e9c-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:52 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.571s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-de138d0f-347b-4db0-8944-df73f2572e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963c996b-148e-4e26-b769-430edb8f382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b6fc94-480e-4039-aab8-de8377141109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "cinder-quobyte-de138d0f-347b-4db0-8944-df73f2572e9c" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Volume volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf (e5c45d66-8c4c-478e-b7af-5f637515e8cf): created successfully Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b6fc94-480e-4039-aab8-de8377141109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Flow 'volume_create_manager' (6fe40ccb-4ee6-411c-a427-2f0c2b6cb2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-73efb303-e002-4448-bddd-919f33fb5577 tempest-VolumesCloneTest-1303827832 None] Created volume successfully. Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-de138d0f-347b-4db0-8944-df73f2572e9c" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Deleting offline snapshot de138d0f-347b-4db0-8944-df73f2572e9c of volume dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:58:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] snapshot_file for this snap is: volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a60229-2e48-4b8b-8e50-3ed1ae040b84]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:53 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c Aug 25 06:58:53 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:53 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c" returned: 0 in 0.466s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2275b57-a976-4b98-9548-7fe59f969c59]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:53 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 Aug 25 06:58:53 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c Aug 25 06:58:54 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Flow 'volume_create_manager' (363e3b0d-df43-43d8-ac06-95aa801fd9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db669c7-4b50-47b5-8f71-b865e225645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db669c7-4b50-47b5-8f71-b865e225645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1664874257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2455f7df-2fba-4ef2-ae24-dc2ccf620d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61511e36ed2e49f4ab161f1662d97566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e5c45d66-8c4c-478e-b7af-5f637515e8cf,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:54Z,use_quota=True,user_id='13b37e2b1604464d91ad7e75a9488b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1957da3e-d11c-4956-b9ec-486dc28a72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1957da3e-d11c-4956-b9ec-486dc28a72f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2278eb9a-b855-400d-a729-3988932c8402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2278eb9a-b855-400d-a729-3988932c8402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2455f7df-2fba-4ef2-ae24-dc2ccf620d1d', 'volume_name': 'volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d', 'volume_size': 2, 'source_volid': 'e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'source_volstatus': 'available'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ea8c6-518f-4c6b-9b53-f3cd3d6a5f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c Aug 25 06:58:54 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ea8c6-518f-4c6b-9b53-f3cd3d6a5f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9400e692-4abf-458b-8f55-d54ae2c81e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Volume 2455f7df-2fba-4ef2-ae24-dc2ccf620d1d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d', 'volume_size': 2, 'source_volid': 'e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'source_volstatus': 'available'} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:54 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Cloning volume e5c45d66-8c4c-478e-b7af-5f637515e8cf to volume 2455f7df-2fba-4ef2-ae24-dc2ccf620d1d Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Creating offline snapshot fefa164f-ce06-4077-a176-2003c0ce7c71 of volume e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce370a8a-cf9b-44b4-83b5-8ff7746da836]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:58:54 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3.de138d0f-347b-4db0-8944-df73f2572e9c" returned: 0 in 0.372s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-de138d0f-347b-4db0-8944-df73f2572e9c" released by "_delete_snapshot" :: held 1.889s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" released by "delete_snapshot" :: held 1.970s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:54 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Created reservations ['43198d92-90d4-4458-9a99-8c717059b8ba', '05342ba5-5e36-407a-bf4a-84032253f5be', 'be98ccc2-17fb-42bd-91c4-d97249efae01', '358121b8-0ef1-4985-9899-6661300826d6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Delete snapshot completed successfully. Aug 25 06:58:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a213d04-4920-4413-925c-c71cc1669db5 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-de138d0f-347b-4db0-8944-df73f2572e9c-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:55 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.689s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:55 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 1G Aug 25 06:58:55 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:55 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 1G" returned: 0 in 0.546s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:55 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:58:55 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 is being set with open permissions: ugo+rw Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "cinder-dd6c7821-0ff4-4a7b-a747-c56086b51fc3-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:56 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:58:56 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-dd6c7821-0ff4-4a7b-a747-c56086b51fc3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" acquired by "delete_volume" :: waited 0.051s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b154e98-3dc8-4c40-a5bb-cdb2ef8b37ba]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 Aug 25 06:58:56 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info Aug 25 06:58:56 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" returned: 0 in 0.540s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info is being set with open permissions: ugo+rw Aug 25 06:58:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3 Aug 25 06:58:57 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info Aug 25 06:58:57 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" returned: 0 in 0.323s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-quobyte-dd6c7821-0ff4-4a7b-a747-c56086b51fc3" released by "delete_volume" :: held 0.966s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:57 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.info" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] snapshot: fefa164f-ce06-4077-a176-2003c0ce7c71, volume: 2455f7df-2fba-4ef2-ae24-dc2ccf620d1d, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[935fff56-2efd-4c5f-9043-f11d8a365736]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Created reservations ['9ad28fbf-dafa-4a6b-8f99-17e35741ecf8', '3b0cf4dd-e10c-4db5-abac-d0916a84d348', '0bc7ee54-b2ee-48c8-b0ab-b38ace512416', '719d08d0-debc-413f-b9d7-e68ba3c8c247'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:58:57 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:58:57 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.390s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:58:57 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c480aea2-979d-4e73-bbd9-1e2bcfdf8736]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Deleted volume successfully. Aug 25 06:58:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-13daab9b-cc9d-4252-a24d-790c593747d1 tempest-SnapshotMetadataTestJSON-2140764535 None] Lock "cinder-dd6c7821-0ff4-4a7b-a747-c56086b51fc3-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:58 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:58:58 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:58 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.397s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:58:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:58:58 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:58:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:58 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d Aug 25 06:58:58 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:00 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:00 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:01 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.563s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:59:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 06:59:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 06:59:03 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" returned: 0 in 5.603s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:03 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:59:03 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Converted 1024.00 MB image at 182.72 MB/s Aug 25 06:59:03 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d is being set with open permissions: ugo+rw Aug 25 06:59:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:03 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d Aug 25 06:59:03 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:04 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" released by "_copy_volume_from_snapshot" :: held 6.849s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-quobyte-fefa164f-ce06-4077-a176-2003c0ce7c71" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-fefa164f-ce06-4077-a176-2003c0ce7c71" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Deleting offline snapshot fefa164f-ce06-4077-a176-2003c0ce7c71 of volume e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] snapshot_file for this snap is: volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a61fa8-7597-465a-a1f8-dc18cf5d9119]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:04 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:59:04 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:04 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.544s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d45613-b5ed-4a2a-9438-1709ef4ee432]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:05 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:59:05 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:05 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.707s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:05 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:59:05 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:06 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.529s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:06 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71 Aug 25 06:59:06 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:06 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf.fefa164f-ce06-4077-a176-2003c0ce7c71" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-fefa164f-ce06-4077-a176-2003c0ce7c71" released by "_delete_snapshot" :: held 2.236s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.112s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9400e692-4abf-458b-8f55-d54ae2c81e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d', 'volume_size': 2, 'source_volid': 'e5c45d66-8c4c-478e-b7af-5f637515e8cf', 'source_volstatus': 'available'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4a5ea5-e482-41ca-87b3-ab13e810d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Volume volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d (2455f7df-2fba-4ef2-ae24-dc2ccf620d1d): created successfully Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4a5ea5-e482-41ca-87b3-ab13e810d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Flow 'volume_create_manager' (363e3b0d-df43-43d8-ac06-95aa801fd9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d1e67494-dde4-4f9d-b328-e0695466ea35 tempest-VolumesCloneTest-1303827832 None] Created volume successfully. Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Flow 'volume_create_manager' (d5da33ff-436a-46fd-a4d2-d53c1cd5bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03a3e29-68fe-436d-9bef-e2848a6b1c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03a3e29-68fe-436d-9bef-e2848a6b1c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1970968375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91cc193-7953-4180-b3e6-448e5b408caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0be7f4a3fc430ea77bb32c85053bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:07Z,use_quota=True,user_id='62fddf223e1f43e4927549b8cc343e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cf5d5d-37f0-4140-a752-87af38070c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cf5d5d-37f0-4140-a752-87af38070c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fec697f-ebc7-4eca-ac69-27717f518881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fec697f-ebc7-4eca-ac69-27717f518881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91cc193-7953-4180-b3e6-448e5b408caf', 'volume_name': 'volume-a91cc193-7953-4180-b3e6-448e5b408caf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc0d045-8fdc-49b0-affa-faeddc61b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc0d045-8fdc-49b0-affa-faeddc61b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45593c48-1849-45c1-a298-acac9081cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:07 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Volume a91cc193-7953-4180-b3e6-448e5b408caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91cc193-7953-4180-b3e6-448e5b408caf', 'volume_size': 1} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1970968375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91cc193-7953-4180-b3e6-448e5b408caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0be7f4a3fc430ea77bb32c85053bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:07Z,use_quota=True,user_id='62fddf223e1f43e4927549b8cc343e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Creating volume a91cc193-7953-4180-b3e6-448e5b408caf {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:07 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:07 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf 1073741824 Aug 25 06:59:07 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:07 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf 1073741824" returned: 0 in 0.540s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:07 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf Aug 25 06:59:07 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[31211630-9834-42cd-81b0-1b677a1926b2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:07 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45593c48-1849-45c1-a298-acac9081cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91cc193-7953-4180-b3e6-448e5b408caf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4750f1f8-2cdd-4050-9269-971b6b15ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:08 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Volume volume-a91cc193-7953-4180-b3e6-448e5b408caf (a91cc193-7953-4180-b3e6-448e5b408caf): created successfully Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4750f1f8-2cdd-4050-9269-971b6b15ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Flow 'volume_create_manager' (d5da33ff-436a-46fd-a4d2-d53c1cd5bee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:08 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d Aug 25 06:59:08 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b6896fc9-2c65-4390-a64b-83d2d8992068 tempest-VolumesTransfersV357Test-567119650 None] Created volume successfully. Aug 25 06:59:08 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" returned: 0 in 0.450s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:08 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d Aug 25 06:59:08 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:08 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d" released by "delete_volume" :: held 0.784s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Created reservations ['6b6f20f7-15a6-491a-b578-d56b20f4f776', 'e0285e77-0da9-46ba-a69d-2f39cddd9670', 'a4a9f62b-fa48-42e6-8948-221115182834', 'ad3c09b6-ab90-45ad-9a73-db8fe1f3da51'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:08 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:08 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:09 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-e5c45d66-8c4c-478e-b7af-5f637515e8cf-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.316s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Deleted volume successfully. Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "cinder-e5c45d66-8c4c-478e-b7af-5f637515e8cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-af52b731-b9aa-4d87-af8b-0faf300c49b0 tempest-VolumesCloneTest-1303827832 None] Lock "cinder-2455f7df-2fba-4ef2-ae24-dc2ccf620d1d-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Acquiring lock "cinder-quobyte-e5c45d66-8c4c-478e-b7af-5f637515e8cf" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-e5c45d66-8c4c-478e-b7af-5f637515e8cf" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeafca3-b57c-41a1-86e0-f1a8144f2179]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:09 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:59:09 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:09 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.509s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:09 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf Aug 25 06:59:09 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-23bcf955-ba81-429a-98fa-19029a0bd138 tempest-VolumesTransfersV357Test-1180838351 None] Transfer volume completed successfully. Aug 25 06:59:10 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5c45d66-8c4c-478e-b7af-5f637515e8cf" returned: 0 in 0.358s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "cinder-quobyte-e5c45d66-8c4c-478e-b7af-5f637515e8cf" released by "delete_volume" :: held 1.005s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (ff714990-6bad-43b2-a4cd-62766348c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a138908-1b73-4e26-832b-86f59b11d357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a138908-1b73-4e26-832b-86f59b11d357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-967715023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d805d75c-7778-4836-b112-59b61fc04c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:10Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe42a903-a3bd-4efb-8321-9729afed0162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe42a903-a3bd-4efb-8321-9729afed0162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d92b2b-a09b-4c1e-947c-12fe91637c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d92b2b-a09b-4c1e-947c-12fe91637c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd805d75c-7778-4836-b112-59b61fc04c40', 'volume_name': 'volume-d805d75c-7778-4836-b112-59b61fc04c40', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7451950-c4de-419b-8495-f69e0beadae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7451950-c4de-419b-8495-f69e0beadae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8de8112-7dbf-427d-80fd-625c22ec757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Volume d805d75c-7778-4836-b112-59b61fc04c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d805d75c-7778-4836-b112-59b61fc04c40', 'volume_size': 1} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-967715023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d805d75c-7778-4836-b112-59b61fc04c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99510e3f0a0648beb1f8ffa55c802ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:10Z,use_quota=True,user_id='2b4d4ae6cf4741e4bdf68804fe1d02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Creating volume d805d75c-7778-4836-b112-59b61fc04c40 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:10 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:10 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 1073741824 Aug 25 06:59:10 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Created reservations ['8a0748d8-785b-42e9-9582-5e02b5ce169e', '20e6b6b3-b7d0-4ddc-a92c-075f289b2615', 'dfdc9f15-76bd-46ab-a96e-50608fdca29c', 'c1dbd7aa-f070-447f-84c6-cccb9cc06ef8'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:10 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:10 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:10 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Deleted volume successfully. Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-09d5a093-2533-41c5-93b3-1bb3d88d9b8b tempest-VolumesCloneTest-1303827832 None] Lock "cinder-e5c45d66-8c4c-478e-b7af-5f637515e8cf-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:10 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 1073741824" returned: 0 in 0.617s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:11 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 Aug 25 06:59:11 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "cinder-a91cc193-7953-4180-b3e6-448e5b408caf-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-a91cc193-7953-4180-b3e6-448e5b408caf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "cinder-quobyte-a91cc193-7953-4180-b3e6-448e5b408caf" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-quobyte-a91cc193-7953-4180-b3e6-448e5b408caf" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb19d72-72ba-4f33-b560-29b3a9c2c072]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:11 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40" returned: 0 in 0.320s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8de8112-7dbf-427d-80fd-625c22ec757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d805d75c-7778-4836-b112-59b61fc04c40', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0643fc18-7d8b-45dc-a4c3-ec0071d24395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:11 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Volume volume-d805d75c-7778-4836-b112-59b61fc04c40 (d805d75c-7778-4836-b112-59b61fc04c40): created successfully Aug 25 06:59:11 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf Aug 25 06:59:11 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0643fc18-7d8b-45dc-a4c3-ec0071d24395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Flow 'volume_create_manager' (ff714990-6bad-43b2-a4cd-62766348c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-509c625e-823a-46b2-b99e-62f1f3c0cbea tempest-AttachVolumeNegativeTest-857282591 None] Created volume successfully. Aug 25 06:59:11 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf" returned: 0 in 0.477s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:11 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf Aug 25 06:59:11 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:11 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a91cc193-7953-4180-b3e6-448e5b408caf" returned: 0 in 0.276s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-quobyte-a91cc193-7953-4180-b3e6-448e5b408caf" released by "delete_volume" :: held 0.802s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Created reservations ['6e8b67ab-a589-448a-87d4-002e3eaf3c91', '95ed6398-3817-4580-86c8-aa2d2a5e65a5', 'cab00031-6bd6-4666-8c98-df3d8d730755', 'a207be7a-c732-4d3c-9a75-45ef95481a6b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:12 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:12 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:12 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Deleted volume successfully. Aug 25 06:59:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9b6b8003-29e8-49c4-94cf-ab2213eef90c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-a91cc193-7953-4180-b3e6-448e5b408caf-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Flow 'volume_create_manager' (1a9722e1-fab3-458e-9a74-ec589fc892d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9ae6af-e456-4764-b595-dbfd44cde440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9ae6af-e456-4764-b595-dbfd44cde440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1843662657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e315e832-e134-4aa9-9eb3-6d9fd1964126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0be7f4a3fc430ea77bb32c85053bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:13Z,use_quota=True,user_id='62fddf223e1f43e4927549b8cc343e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3095f-0bcc-4b98-922c-e0c51d4e8e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3095f-0bcc-4b98-922c-e0c51d4e8e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd1746c-86b1-40f0-8253-542afcfaa3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd1746c-86b1-40f0-8253-542afcfaa3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e315e832-e134-4aa9-9eb3-6d9fd1964126', 'volume_name': 'volume-e315e832-e134-4aa9-9eb3-6d9fd1964126', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b85b39a-755e-4f3e-a465-61094c651a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b85b39a-755e-4f3e-a465-61094c651a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87dd78c-5e68-45ff-b1db-dc8c0b413054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Volume e315e832-e134-4aa9-9eb3-6d9fd1964126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e315e832-e134-4aa9-9eb3-6d9fd1964126', 'volume_size': 1} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1843662657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e315e832-e134-4aa9-9eb3-6d9fd1964126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0be7f4a3fc430ea77bb32c85053bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:13Z,use_quota=True,user_id='62fddf223e1f43e4927549b8cc343e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Creating volume e315e832-e134-4aa9-9eb3-6d9fd1964126 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:13 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:13 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 1073741824 Aug 25 06:59:13 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-7ac052af-0ccd-4059-9eaf-32d105b1e703 req-dbd0b986-9b1b-489d-abef-f40428b10d35 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:13 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 1073741824" returned: 0 in 0.593s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:13 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 Aug 25 06:59:13 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (1186aeab-1a8f-42aa-a3cb-d62e7d01ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74c3614-7c8e-48c4-9e2c-2c168cdbbfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74c3614-7c8e-48c4-9e2c-2c168cdbbfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1423247263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662b94a8-a746-480a-9e8c-1d355e24230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:14Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe46653e-989a-42cc-9c85-e8d0b85ef100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe46653e-989a-42cc-9c85-e8d0b85ef100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24da742-44d0-4121-8114-9c9c5f2adaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24da742-44d0-4121-8114-9c9c5f2adaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662b94a8-a746-480a-9e8c-1d355e24230f', 'volume_name': 'volume-662b94a8-a746-480a-9e8c-1d355e24230f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140bc54a-4975-4211-87e1-afb8b4a44b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140bc54a-4975-4211-87e1-afb8b4a44b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c0dbc9-8cbf-4842-834e-d9e7fb673cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 662b94a8-a746-480a-9e8c-1d355e24230f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662b94a8-a746-480a-9e8c-1d355e24230f', 'volume_size': 1} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:14 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126" returned: 0 in 0.285s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-7ac052af-0ccd-4059-9eaf-32d105b1e703 req-dbd0b986-9b1b-489d-abef-f40428b10d35 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.692s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-7ac052af-0ccd-4059-9eaf-32d105b1e703 req-dbd0b986-9b1b-489d-abef-f40428b10d35 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1423247263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662b94a8-a746-480a-9e8c-1d355e24230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:14Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 662b94a8-a746-480a-9e8c-1d355e24230f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:14 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87dd78c-5e68-45ff-b1db-dc8c0b413054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e315e832-e134-4aa9-9eb3-6d9fd1964126', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1ed3f3-904f-43e1-83d2-42a6d577221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:14 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f 1073741824 Aug 25 06:59:14 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Volume volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 (e315e832-e134-4aa9-9eb3-6d9fd1964126): created successfully Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1ed3f3-904f-43e1-83d2-42a6d577221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Flow 'volume_create_manager' (1a9722e1-fab3-458e-9a74-ec589fc892d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-7ac052af-0ccd-4059-9eaf-32d105b1e703 req-dbd0b986-9b1b-489d-abef-f40428b10d35 tempest-AttachVolumeNegativeTest-857282591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-d805d75c-7778-4836-b112-59b61fc04c40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65b55953-3d29-45a0-96d7-76fe9dd7bc5d', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 06:59:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-39feff44-8c1b-42af-9dcc-1197b8d98bc8 tempest-VolumesTransfersV357Test-567119650 None] Created volume successfully. Aug 25 06:59:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-7ac052af-0ccd-4059-9eaf-32d105b1e703 req-dbd0b986-9b1b-489d-abef-f40428b10d35 tempest-AttachVolumeNegativeTest-857282591 None] attachment_update completed successfully. Aug 25 06:59:14 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f 1073741824" returned: 0 in 0.584s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:14 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f Aug 25 06:59:14 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:15 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f" returned: 0 in 0.328s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c0dbc9-8cbf-4842-834e-d9e7fb673cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662b94a8-a746-480a-9e8c-1d355e24230f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b17da-4e10-4d97-a1d4-25e9118df27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:15 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-662b94a8-a746-480a-9e8c-1d355e24230f (662b94a8-a746-480a-9e8c-1d355e24230f): created successfully Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b17da-4e10-4d97-a1d4-25e9118df27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (1186aeab-1a8f-42aa-a3cb-d62e7d01ba07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5034e5cd-d4d4-434b-8365-2d8dcdceb1d7 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "cinder-e315e832-e134-4aa9-9eb3-6d9fd1964126-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-e315e832-e134-4aa9-9eb3-6d9fd1964126-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "cinder-quobyte-e315e832-e134-4aa9-9eb3-6d9fd1964126" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-quobyte-e315e832-e134-4aa9-9eb3-6d9fd1964126" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3167b0ea-99f5-40e4-a559-5466a77a6d10]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:16 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 Aug 25 06:59:16 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:16 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126" returned: 0 in 0.487s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:16 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126 Aug 25 06:59:16 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:16 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e315e832-e134-4aa9-9eb3-6d9fd1964126" returned: 0 in 0.346s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (9ec96b4f-46bb-431e-a273-dd3648117835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1850e614-21b3-4e2e-88df-38e306843905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-quobyte-e315e832-e134-4aa9-9eb3-6d9fd1964126" released by "delete_volume" :: held 0.953s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1850e614-21b3-4e2e-88df-38e306843905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22412899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:17Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da8497e-cf85-4b52-83bb-2248f65f20f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da8497e-cf85-4b52-83bb-2248f65f20f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e243d3-69de-48c2-a040-97f8ac891620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e243d3-69de-48c2-a040-97f8ac891620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a', 'volume_name': 'volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733c22a1-12c1-49ae-80b2-36bf35550ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733c22a1-12c1-49ae-80b2-36bf35550ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a09eee-e8a0-4a11-a317-cbd6a20152f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a', 'volume_size': 1} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22412899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:17Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:16 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:16 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a 1073741824 Aug 25 06:59:16 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Created reservations ['b4f6c03c-8080-40b7-89dc-4bf26d97308a', '01c44315-cd0e-43b5-af45-4d844fb42830', '6ecfeb41-db9d-4c0c-9766-6bb986f9e884', '0ab02414-cf15-4d3f-8c04-c52073cf720c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:17 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:17 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (9b2fa9d6-ce52-430e-a929-1b734775ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd773fb-8969-4e8d-8ab5-184be8d40c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd773fb-8969-4e8d-8ab5-184be8d40c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1428462196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8948b0-a0e8-4556-a2dc-d78efc78e409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:17Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ae6b26-d21c-400b-9c63-64c65915e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ae6b26-d21c-400b-9c63-64c65915e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28002033-08cc-479b-9be7-228feb860e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28002033-08cc-479b-9be7-228feb860e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8948b0-a0e8-4556-a2dc-d78efc78e409', 'volume_name': 'volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc49b761-b597-481d-a663-a9951f69cc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc49b761-b597-481d-a663-a9951f69cc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095c5efc-ee9b-4738-a7a3-07dfe19c5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 1c8948b0-a0e8-4556-a2dc-d78efc78e409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409', 'volume_size': 1} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:17 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a 1073741824" returned: 0 in 0.727s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:17 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.600s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Deleted volume successfully. Aug 25 06:59:17 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a Aug 25 06:59:17 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44972084-0067-49a5-b537-0edee681fa9c tempest-VolumesTransfersV357Test-1684521098 None] Lock "cinder-e315e832-e134-4aa9-9eb3-6d9fd1964126-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:18 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1428462196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8948b0-a0e8-4556-a2dc-d78efc78e409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:17Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 1c8948b0-a0e8-4556-a2dc-d78efc78e409 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:18 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:18 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 1073741824 Aug 25 06:59:18 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a09eee-e8a0-4a11-a317-cbd6a20152f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb79d804-a5e3-4a1b-b0a0-e9445dbb0593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a (9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a): created successfully Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb79d804-a5e3-4a1b-b0a0-e9445dbb0593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (9ec96b4f-46bb-431e-a273-dd3648117835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (4459375b-d6ce-4f16-95c8-b5c62e4fbf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10df06d-139c-4feb-a8a5-c15c162096ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d65a1bbc-6f0c-40f0-a0d9-45d032a69911 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10df06d-139c-4feb-a8a5-c15c162096ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800902671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253aa6a5-b007-46e4-ba7d-30b912a075f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803a6544-7e0f-490b-8d23-e451e741f3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803a6544-7e0f-490b-8d23-e451e741f3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c052e-1b03-47ca-8307-2f5c75f37acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c052e-1b03-47ca-8307-2f5c75f37acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253aa6a5-b007-46e4-ba7d-30b912a075f4', 'volume_name': 'volume-253aa6a5-b007-46e4-ba7d-30b912a075f4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d770b32e-b7e4-413b-8d9d-03178a78b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d770b32e-b7e4-413b-8d9d-03178a78b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2765bc-0f55-42b3-b5d8-0a02d443f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 253aa6a5-b007-46e4-ba7d-30b912a075f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253aa6a5-b007-46e4-ba7d-30b912a075f4', 'volume_size': 1} Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-cbef55f3-e952-4d30-9ab0-c2d7e6bfea3f req-a421fbd6-5649-4afc-a7dc-01ea2fad91cc tempest-AttachVolumeNegativeTest-857282591 None] Terminate volume connection completed successfully. Aug 25 06:59:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-cbef55f3-e952-4d30-9ab0-c2d7e6bfea3f req-a421fbd6-5649-4afc-a7dc-01ea2fad91cc tempest-AttachVolumeNegativeTest-857282591 None] Deleting attachment 65b55953-3d29-45a0-96d7-76fe9dd7bc5d. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 06:59:19 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 1073741824" returned: 0 in 0.979s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (ee55726b-2b42-4307-a82f-7d193d97da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14d4cc-f178-4756-8873-f9599509f94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14d4cc-f178-4756-8873-f9599509f94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032320283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce0a54-de70-44ff-b207-b2c13fb897dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:19Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2753d7a-9a77-40c2-8804-1073651a34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2753d7a-9a77-40c2-8804-1073651a34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5569455-c66d-455a-82a2-bc70469a038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5569455-c66d-455a-82a2-bc70469a038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ce0a54-de70-44ff-b207-b2c13fb897dd', 'volume_name': 'volume-86ce0a54-de70-44ff-b207-b2c13fb897dd', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b3e47c-04b3-407c-b6b6-5b28bcc7f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b3e47c-04b3-407c-b6b6-5b28bcc7f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6222a7e-adc9-4891-83d7-c9b82506fe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 86ce0a54-de70-44ff-b207-b2c13fb897dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ce0a54-de70-44ff-b207-b2c13fb897dd', 'volume_size': 1} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:19 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 Aug 25 06:59:19 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:19 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409" returned: 0 in 0.462s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800902671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253aa6a5-b007-46e4-ba7d-30b912a075f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 253aa6a5-b007-46e4-ba7d-30b912a075f4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:19 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095c5efc-ee9b-4738-a7a3-07dfe19c5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 1073741824 Aug 25 06:59:19 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16166f-7fe0-4508-9e55-97753c87607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 (1c8948b0-a0e8-4556-a2dc-d78efc78e409): created successfully Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16166f-7fe0-4508-9e55-97753c87607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (9b2fa9d6-ce52-430e-a929-1b734775ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c6bd8e49-8586-4c19-80c7-6c612fd9176b tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (f8976600-9bf7-4301-8419-e0bfae47e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df0bddc-89f9-4db9-92c9-7abf99dae1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df0bddc-89f9-4db9-92c9-7abf99dae1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058429369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c93232-6249-4f49-bf64-883a4467f898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d703b2b1-b4af-4b9d-810c-9e6330353589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d703b2b1-b4af-4b9d-810c-9e6330353589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387e2123-ca57-4723-a07a-505ccf0c2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387e2123-ca57-4723-a07a-505ccf0c2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c93232-6249-4f49-bf64-883a4467f898', 'volume_name': 'volume-16c93232-6249-4f49-bf64-883a4467f898', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412dbe10-d15c-4c99-b9db-048c97583501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412dbe10-d15c-4c99-b9db-048c97583501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7bf535-f5de-430e-b1bb-e6709a3b1bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume 16c93232-6249-4f49-bf64-883a4467f898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c93232-6249-4f49-bf64-883a4467f898', 'volume_size': 1} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:20 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 1073741824" returned: 0 in 0.765s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:20 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 Aug 25 06:59:20 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:20 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4" returned: 0 in 0.393s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032320283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce0a54-de70-44ff-b207-b2c13fb897dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:19Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 86ce0a54-de70-44ff-b207-b2c13fb897dd {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:21 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2765bc-0f55-42b3-b5d8-0a02d443f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253aa6a5-b007-46e4-ba7d-30b912a075f4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e291ec5-ee72-4646-9a53-7c1a51ed1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:21 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd 1073741824 Aug 25 06:59:21 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 (253aa6a5-b007-46e4-ba7d-30b912a075f4): created successfully Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e291ec5-ee72-4646-9a53-7c1a51ed1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (4459375b-d6ce-4f16-95c8-b5c62e4fbf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-93802172-25a1-4561-a56b-1a96782b43a8 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:21 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd 1073741824" returned: 0 in 0.536s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:21 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd Aug 25 06:59:21 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:21 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058429369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c93232-6249-4f49-bf64-883a4467f898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cde9ad75b1c4051a8dc1deda77b1113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='2e96812fc2644bd9a69f3c3306bb4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Creating volume 16c93232-6249-4f49-bf64-883a4467f898 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:21 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6222a7e-adc9-4891-83d7-c9b82506fe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ce0a54-de70-44ff-b207-b2c13fb897dd', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7e2d00-10e6-40e9-8aae-d8851c12f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:21 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 1073741824 Aug 25 06:59:21 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-86ce0a54-de70-44ff-b207-b2c13fb897dd (86ce0a54-de70-44ff-b207-b2c13fb897dd): created successfully Aug 25 06:59:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7e2d00-10e6-40e9-8aae-d8851c12f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (ee55726b-2b42-4307-a82f-7d193d97da21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-edc02003-1ce2-49e9-8987-5be47104960f tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:22 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 1073741824" returned: 0 in 0.608s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:22 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 Aug 25 06:59:22 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:23 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7bf535-f5de-430e-b1bb-e6709a3b1bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c93232-6249-4f49-bf64-883a4467f898', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f275e5d0-83db-44fa-82af-f41b1b4472b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Volume volume-16c93232-6249-4f49-bf64-883a4467f898 (16c93232-6249-4f49-bf64-883a4467f898): created successfully Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f275e5d0-83db-44fa-82af-f41b1b4472b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Flow 'volume_create_manager' (f8976600-9bf7-4301-8419-e0bfae47e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-32df4cde-f136-4c58-a43d-26739a8e537c tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created volume successfully. Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-16c93232-6249-4f49-bf64-883a4467f898-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-16c93232-6249-4f49-bf64-883a4467f898-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-16c93232-6249-4f49-bf64-883a4467f898" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-16c93232-6249-4f49-bf64-883a4467f898" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39b1ce-2789-4ca9-b34e-9155fe6a6c02]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:23 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 Aug 25 06:59:23 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:24 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:24 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898 Aug 25 06:59:24 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:24 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-16c93232-6249-4f49-bf64-883a4467f898" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-16c93232-6249-4f49-bf64-883a4467f898" released by "delete_volume" :: held 0.816s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['5cb1b79d-ddad-491b-a9be-6756ada2f339', '9e76fab0-679c-4f66-b3a5-71e8766cd9c7', '95d16de3-95a3-4a8e-b80a-1ebf100a1082', '26f0b5d0-00d9-45d2-849b-614e6c4c0210'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:24 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:24 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-86ce0a54-de70-44ff-b207-b2c13fb897dd-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-86ce0a54-de70-44ff-b207-b2c13fb897dd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-86ce0a54-de70-44ff-b207-b2c13fb897dd" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-86ce0a54-de70-44ff-b207-b2c13fb897dd" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b0680-7453-485c-b4ba-3b260a1cbd84]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:25 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:25 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd Aug 25 06:59:25 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e126fa1b-47c9-4a3e-917d-b0f02c041102 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-16c93232-6249-4f49-bf64-883a4467f898-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:25 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:25 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd Aug 25 06:59:25 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:25 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-86ce0a54-de70-44ff-b207-b2c13fb897dd" returned: 0 in 0.316s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-86ce0a54-de70-44ff-b207-b2c13fb897dd" released by "delete_volume" :: held 0.776s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['3319a925-46c7-4cf6-a19a-4f2aa2295935', '06a27933-fd6f-484f-a3d5-303a5eb03444', '3da74e8d-0b7f-4cd8-85a3-df3846c879f3', '99d5f4c9-fe19-4cae-90d1-ccfbb006296b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:25 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:25 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-253aa6a5-b007-46e4-ba7d-30b912a075f4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-253aa6a5-b007-46e4-ba7d-30b912a075f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-253aa6a5-b007-46e4-ba7d-30b912a075f4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-253aa6a5-b007-46e4-ba7d-30b912a075f4" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd747b78-0194-4a7a-bfcf-db104cefd5f6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:26 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.425s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f9b2b48-d672-493e-aeaa-1878c35c0e17 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-86ce0a54-de70-44ff-b207-b2c13fb897dd-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:26 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 Aug 25 06:59:26 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:26 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4" returned: 0 in 0.531s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:26 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4 Aug 25 06:59:26 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:27 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-253aa6a5-b007-46e4-ba7d-30b912a075f4" returned: 0 in 0.335s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-253aa6a5-b007-46e4-ba7d-30b912a075f4" released by "delete_volume" :: held 0.917s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['24614201-b50a-45c4-ad63-2d00461fb3dd', '5b82bc7b-cc72-4ea3-adef-132581a3543b', 'f62b8f93-dc7f-4c81-90a9-64b4af5f8dd5', '5e01884c-f024-42a1-b1b1-508f875aeb55'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:27 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:27 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:27 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-64887c18-da63-4ecc-9374-114743d63709 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-253aa6a5-b007-46e4-ba7d-30b912a075f4-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-d805d75c-7778-4836-b112-59b61fc04c40-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-d805d75c-7778-4836-b112-59b61fc04c40-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-quobyte-d805d75c-7778-4836-b112-59b61fc04c40" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-d805d75c-7778-4836-b112-59b61fc04c40" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5607e76-7ec3-49a5-bfe0-06f5357e0633]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-1c8948b0-a0e8-4556-a2dc-d78efc78e409-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:28 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 Aug 25 06:59:28 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-1c8948b0-a0e8-4556-a2dc-d78efc78e409-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-1c8948b0-a0e8-4556-a2dc-d78efc78e409" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-1c8948b0-a0e8-4556-a2dc-d78efc78e409" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46266a9-5584-47cc-9f92-b056f799bf32]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:28 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 Aug 25 06:59:28 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:28 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40" returned: 0 in 0.500s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:28 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40 Aug 25 06:59:28 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:29 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409" returned: 0 in 0.465s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:29 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409 Aug 25 06:59:29 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:29 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d805d75c-7778-4836-b112-59b61fc04c40" returned: 0 in 0.349s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-d805d75c-7778-4836-b112-59b61fc04c40" released by "delete_volume" :: held 0.915s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Created reservations ['2e749c9e-a53c-44cb-aaa5-cb529ea89342', '66e35a7b-856a-48af-8fda-a6133d2c32de', '7a583cab-8859-4197-ade6-39840fdcd0d6', 'f19689c2-8f9a-495c-a84e-4c472e07de6b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:29 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:29 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:29 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1c8948b0-a0e8-4556-a2dc-d78efc78e409" returned: 0 in 0.405s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-1c8948b0-a0e8-4556-a2dc-d78efc78e409" released by "delete_volume" :: held 0.930s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['90ccbd1f-8a14-45a2-9fd3-ae9d96a0b407', '9f512caf-18d1-4051-a3da-815ad375c65c', '7a10584f-068a-4887-b0e4-38f2aaadf273', 'f09de0b7-d2ce-4872-8079-47f88adbe033'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:29 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:29 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.349s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:29 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Deleted volume successfully. Aug 25 06:59:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62f07fd0-03b9-49eb-ba9d-9400d01efdf3 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-d805d75c-7778-4836-b112-59b61fc04c40-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:30 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b5a1129f-d30c-4955-b550-8e950ef028f6 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-1c8948b0-a0e8-4556-a2dc-d78efc78e409-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-9a85a3df-5ac6-4e05-8971-0a33db1db679-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-9a85a3df-5ac6-4e05-8971-0a33db1db679-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-quobyte-9a85a3df-5ac6-4e05-8971-0a33db1db679" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-9a85a3df-5ac6-4e05-8971-0a33db1db679" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53fcea-1e70-4e03-ac06-c6455d1f062f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 Aug 25 06:59:30 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcac4ef-29ee-43f3-b312-59ba00083f00]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a Aug 25 06:59:31 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679" returned: 0 in 0.546s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679 Aug 25 06:59:31 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (eeff2417-24d0-433b-b5e0-ca68938fc1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b371b6-7770-415a-ae5a-5114283336d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:31 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" returned: 0 in 0.611s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b371b6-7770-415a-ae5a-5114283336d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-81681523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80e5b15-926e-4fcf-aa9b-c7342fc65ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:32Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441a83a-02de-4ff2-940c-be9d3c7ec519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:31 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a Aug 25 06:59:31 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441a83a-02de-4ff2-940c-be9d3c7ec519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69fddb8-a3a6-4775-a76a-d0ded269e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69fddb8-a3a6-4775-a76a-d0ded269e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80e5b15-926e-4fcf-aa9b-c7342fc65ec5', 'volume_name': 'volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7903a9e-cf32-4ca2-9858-feff96bfb8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:31 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7903a9e-cf32-4ca2-9858-feff96bfb8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6891b-31fb-4773-b8d7-51b7940bfb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:31 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Volume c80e5b15-926e-4fcf-aa9b-c7342fc65ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5', 'volume_size': 1} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-81681523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80e5b15-926e-4fcf-aa9b-c7342fc65ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:32Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Creating volume c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:31 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9a85a3df-5ac6-4e05-8971-0a33db1db679" returned: 0 in 0.399s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:31 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 1073741824 Aug 25 06:59:31 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-9a85a3df-5ac6-4e05-8971-0a33db1db679" released by "delete_volume" :: held 1.048s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Created reservations ['baba5dd8-2c08-43d6-a981-506b4bb78771', 'dea647ad-b3b1-4d1d-8c42-8feeabe5fc21', 'b410d14a-52af-47b6-bbc6-d7ded7eec3d4', 'bd37911f-30c7-444a-9b76-e245a5e871f4'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:31 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a" released by "delete_volume" :: held 0.995s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:32 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:32 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['a680913d-1729-4775-aac2-c8c623fd9e92', '841eacde-8c40-43f6-a5b4-111df7ef30a6', 'ef0f97eb-8ef2-457e-a9bf-fffce1716110', '116e2735-45c3-4205-bbc9-7e52c845c67b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:32 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:32 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:32 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 1073741824" returned: 0 in 0.608s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.330s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Deleted volume successfully. Aug 25 06:59:32 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 Aug 25 06:59:32 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7df697d2-6dae-452d-b2cc-12e71b1458d1 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-9a85a3df-5ac6-4e05-8971-0a33db1db679-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:32 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.302s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-23e36fdf-fb86-4b2a-8efc-e538cb962559 tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-9eee7b4d-1a52-4e1a-a01c-6a4b5488f95a-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:32 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" returned: 0 in 0.327s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6891b-31fb-4773-b8d7-51b7940bfb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea683fc9-cdbf-4705-b368-5b1d37f4501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Volume volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 (c80e5b15-926e-4fcf-aa9b-c7342fc65ec5): created successfully Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea683fc9-cdbf-4705-b368-5b1d37f4501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (eeff2417-24d0-433b-b5e0-ca68938fc1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b507a9ff-5c2c-4dec-b1d4-a82f028675a7 tempest-VolumesSnapshotTestJSON-181853129 None] Created volume successfully. Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-662b94a8-a746-480a-9e8c-1d355e24230f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-11d2b28e-d922-4857-b409-97e6eee15569-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-662b94a8-a746-480a-9e8c-1d355e24230f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-11d2b28e-d922-4857-b409-97e6eee15569-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "cinder-quobyte-662b94a8-a746-480a-9e8c-1d355e24230f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-662b94a8-a746-480a-9e8c-1d355e24230f" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "cinder-quobyte-11d2b28e-d922-4857-b409-97e6eee15569" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[550386b2-c7bc-49b6-af88-cfc333130917]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-11d2b28e-d922-4857-b409-97e6eee15569" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[915bb848-24c2-4e2c-b9e1-ff37b85eb59f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f Aug 25 06:59:33 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:33 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 Aug 25 06:59:33 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:33 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f" returned: 0 in 0.454s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f Aug 25 06:59:33 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:33 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569" returned: 0 in 0.475s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569 Aug 25 06:59:33 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Creating offline snapshot e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 of volume c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[492642ac-9dca-45a0-883e-391338945e0f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:34 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-11d2b28e-d922-4857-b409-97e6eee15569" returned: 0 in 0.302s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-quobyte-11d2b28e-d922-4857-b409-97e6eee15569" released by "delete_volume" :: held 0.827s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:34 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-662b94a8-a746-480a-9e8c-1d355e24230f" returned: 0 in 0.407s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-quobyte-662b94a8-a746-480a-9e8c-1d355e24230f" released by "delete_volume" :: held 0.917s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:34 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 Aug 25 06:59:34 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Created reservations ['b9721f34-6a6d-4aab-a89d-e26c50df4f85', '423d1328-7fbf-4e21-b5e8-5793d7c9f771', '658cd12a-fc58-4f1a-adbb-2a84341b120a', '99288651-1cb9-4d06-b90d-c5f85f8c4234'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Created reservations ['d03ee421-b3ed-4c70-8fc1-295e840ed6f4', '401c4e25-762f-4f01-b0e0-8dea90308969', '7f24b621-52cf-486f-a2a2-6a5d61b70663', '2ca2e164-cb6e-49ba-8fad-29131a3ed430'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:34 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:34 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:34 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:34 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" returned: 0 in 0.441s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:34 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 1G Aug 25 06:59:34 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Deleted volume successfully. Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54ead8e4-6134-4a54-b948-e6369f9ea266 tempest-AttachVolumeNegativeTest-857282591 None] Lock "cinder-11d2b28e-d922-4857-b409-97e6eee15569-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:34 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Deleted volume successfully. Aug 25 06:59:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0debb22a-fb3b-47e5-8cdd-69af9ded44af tempest-CreateVolumesFromSourceVolumeTest-70854900 None] Lock "cinder-662b94a8-a746-480a-9e8c-1d355e24230f-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:35 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 1G" returned: 0 in 0.576s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:35 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 Aug 25 06:59:35 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:35 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" returned: 0 in 0.384s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:35 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 is being set with open permissions: ugo+rw Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:35 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 Aug 25 06:59:35 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:35 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=131,cinder:UPDATE=194,cinder:INSERT=36,cinder:DELETE=16 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=167,cinder:INSERT=49,cinder:DELETE=15,cinder:SELECT=130 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:59:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:35 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info Aug 25 06:59:35 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info is being set with open permissions: ugo+rw Aug 25 06:59:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:36 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info Aug 25 06:59:36 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.info" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-13ffc54b-0c99-4627-aae7-25733c5ee698 tempest-VolumesSnapshotTestJSON-181853129 None] Create snapshot completed successfully Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Deleting offline snapshot e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 of volume c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] snapshot_file for this snap is: volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0aad37-ca19-4bb9-9a7b-0df7c0350199]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:37 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 Aug 25 06:59:37 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:37 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" returned: 0 in 0.464s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[04253d1b-412a-456e-9952-73d79ac6b766]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:38 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 Aug 25 06:59:38 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:38 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" returned: 0 in 0.449s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:38 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 Aug 25 06:59:38 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:38 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:38 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139 Aug 25 06:59:38 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:39 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5.e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139" released by "_delete_snapshot" :: held 1.866s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" released by "delete_snapshot" :: held 1.898s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:39 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['b20ffeba-3a2b-451f-8fed-3b74b454e5ce', '238ec8a5-d359-46cc-ac5b-70ca9d7a6f20', 'db661f11-f5ce-4c65-b758-498543f2ff19', 'cfa28044-1630-42ca-b6d0-fc28c235b651'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Delete snapshot completed successfully. Aug 25 06:59:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c31d1a77-a871-4f7a-a03c-049e8e81cc68 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-e0dcc2bd-44bb-44cc-8ca7-9623e84fb139-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (6a170956-9c33-4bda-aae0-a0a384b4b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79222c86-a488-496c-8823-7b4ec1422bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79222c86-a488-496c-8823-7b4ec1422bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1745307801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9363e74b-aa26-4242-afd0-27c9488f4d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:41Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e53f3b7-ea1f-4e97-a2e8-18dac88348ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e53f3b7-ea1f-4e97-a2e8-18dac88348ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968020da-f95a-4815-87b3-ca04ca2b7642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968020da-f95a-4815-87b3-ca04ca2b7642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9363e74b-aa26-4242-afd0-27c9488f4d41', 'volume_name': 'volume-9363e74b-aa26-4242-afd0-27c9488f4d41', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47717272-54c3-4dc3-bd9b-ac88b951255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47717272-54c3-4dc3-bd9b-ac88b951255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adcce22-77cb-46e2-a244-a1d99f7476fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Volume 9363e74b-aa26-4242-afd0-27c9488f4d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9363e74b-aa26-4242-afd0-27c9488f4d41', 'volume_size': 1} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1745307801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9363e74b-aa26-4242-afd0-27c9488f4d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:41Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Creating volume 9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:41 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:41 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 1073741824 Aug 25 06:59:41 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:42 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 1073741824" returned: 0 in 0.783s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:42 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 06:59:42 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:42 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adcce22-77cb-46e2-a244-a1d99f7476fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9363e74b-aa26-4242-afd0-27c9488f4d41', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe6142b-cd00-4202-b8e7-252a47a6aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Volume volume-9363e74b-aa26-4242-afd0-27c9488f4d41 (9363e74b-aa26-4242-afd0-27c9488f4d41): created successfully Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe6142b-cd00-4202-b8e7-252a47a6aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (6a170956-9c33-4bda-aae0-a0a384b4b69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-67a6e64b-d958-4abf-9a4b-a598857b39da tempest-VolumesSnapshotTestJSON-181853129 None] Created volume successfully. Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Flow 'volume_create_manager' (887cb2cf-2785-4c4f-b180-73ab04cc7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4016878c-ff16-4a8b-aeff-05b928fef617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4016878c-ff16-4a8b-aeff-05b928fef617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1742193226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8426f5fa-3c49-444e-bc7f-a3fbe54ec129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b8fb67e2334d35ba36d220e9e6d04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:43Z,use_quota=True,user_id='e2141bc581c04649b30185da62266577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d32aa1-f42b-4b77-8e8a-667335c01d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d32aa1-f42b-4b77-8e8a-667335c01d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8a5ac-4574-4403-9627-cac4d7f3bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8a5ac-4574-4403-9627-cac4d7f3bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8426f5fa-3c49-444e-bc7f-a3fbe54ec129', 'volume_name': 'volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2f966-519c-40d2-8b03-1986a3515967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2f966-519c-40d2-8b03-1986a3515967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f52637-e07f-4622-9892-cacfdea7d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Volume 8426f5fa-3c49-444e-bc7f-a3fbe54ec129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129', 'volume_size': 1} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1742193226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8426f5fa-3c49-444e-bc7f-a3fbe54ec129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b8fb67e2334d35ba36d220e9e6d04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:43Z,use_quota=True,user_id='e2141bc581c04649b30185da62266577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Creating volume 8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:43 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:43 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 1073741824 Aug 25 06:59:43 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:43 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 1073741824" returned: 0 in 0.576s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:43 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 06:59:43 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:44 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.627s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f52637-e07f-4622-9892-cacfdea7d77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6b81f-36bc-452f-9819-2d9b7aaec617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Creating offline snapshot bd5c656d-abad-4983-acd4-242c6932f448 of volume 9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:59:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Volume volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 (8426f5fa-3c49-444e-bc7f-a3fbe54ec129): created successfully Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6b81f-36bc-452f-9819-2d9b7aaec617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Flow 'volume_create_manager' (887cb2cf-2785-4c4f-b180-73ab04cc7d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b8bddf-a259-47a1-9252-1bc9f2c933f6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0774e8ac-7de7-4d85-a211-9d46e0ac8536 tempest-VolumeDependencyTests-1888836171 None] Created volume successfully. Aug 25 06:59:44 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 06:59:44 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:44 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:44 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 1G Aug 25 06:59:44 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:45 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 1G" returned: 0 in 0.560s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9363e74b-aa26-4242-afd0-27c9488f4d41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:45 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9363e74b-aa26-4242-afd0-27c9488f4d41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 06:59:45 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:45 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9363e74b-aa26-4242-afd0-27c9488f4d41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 0.429s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:45 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 is being set with open permissions: ugo+rw Aug 25 06:59:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:45 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 06:59:45 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info Aug 25 06:59:46 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info is being set with open permissions: ugo+rw Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info Aug 25 06:59:46 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.info" returned: 0 in 0.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.163s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Creating offline snapshot bb1fc58f-324c-4a1c-b350-174ebe63b138 of volume 8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7905baed-67b5-4ab5-8436-523832844c5f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e4daa881-7f1e-46e6-856e-71f9aa2d962a tempest-VolumesSnapshotTestJSON-181853129 None] Create snapshot completed successfully Aug 25 06:59:46 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 06:59:46 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:47 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.448s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:47 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 1G Aug 25 06:59:47 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:47 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 1G" returned: 0 in 0.557s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:47 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 06:59:47 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 is being set with open permissions: ugo+rw Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:48 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 06:59:48 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.416s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:48 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info Aug 25 06:59:48 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (dd6b4cc8-5278-4793-8c09-d4b41087427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d65eca-6a5b-4a5f-ba62-84baa94cdd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d65eca-6a5b-4a5f-ba62-84baa94cdd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337681508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42eefe9-0a12-49f7-8a59-7339a5ff648f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bd5c656d-abad-4983-acd4-242c6932f448,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:49Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619a0787-832d-46b4-a193-38e02ead5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619a0787-832d-46b4-a193-38e02ead5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcaec790-bf41-4f7c-b029-cd464370401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcaec790-bf41-4f7c-b029-cd464370401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b42eefe9-0a12-49f7-8a59-7339a5ff648f', 'volume_name': 'volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f', 'volume_size': 2, 'snapshot_id': 'bd5c656d-abad-4983-acd4-242c6932f448'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec371e3-5d30-4e8b-ab08-a1614a1d5a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec371e3-5d30-4e8b-ab08-a1614a1d5a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d634fa-25c6-41cb-87a9-7ad325f50721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Volume b42eefe9-0a12-49f7-8a59-7339a5ff648f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f', 'volume_size': 2, 'snapshot_id': 'bd5c656d-abad-4983-acd4-242c6932f448'} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:49 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:49 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info is being set with open permissions: ugo+rw Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:49 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info Aug 25 06:59:49 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0ae1a268-7505-4f7a-ab5c-f33e103d3621 tempest-GroupSnapshotsV319Test-1508353052 None] Group tempest-GroupSnapshotsV319Test-Group-613594061: creating Aug 25 06:59:49 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.info" returned: 0 in 0.324s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.416s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448-b42eefe9-0a12-49f7-8a59-7339a5ff648f" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448-b42eefe9-0a12-49f7-8a59-7339a5ff648f" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Creating volume b42eefe9-0a12-49f7-8a59-7339a5ff648f from snapshot bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a5f27d7c-f1c3-457c-9d6f-81a357fd4a63 tempest-VolumeDependencyTests-1888836171 None] Create snapshot completed successfully Aug 25 06:59:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0ae1a268-7505-4f7a-ab5c-f33e103d3621 tempest-GroupSnapshotsV319Test-1508353052 None] Group tempest-GroupSnapshotsV319Test-Group-613594061: created successfully Aug 25 06:59:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0ae1a268-7505-4f7a-ab5c-f33e103d3621 tempest-GroupSnapshotsV319Test-1508353052 None] Create group completed successfully. Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] snapshot: bd5c656d-abad-4983-acd4-242c6932f448, volume: b42eefe9-0a12-49f7-8a59-7339a5ff648f, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6497459c-a56a-4642-aedf-a1174c94e6e5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:49 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 06:59:49 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 0.452s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9363e74b-aa26-4242-afd0-27c9488f4d41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d74ef0-6f81-4754-8a02-6c765793170b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:50 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 06:59:50 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Flow 'volume_create_manager' (bf2c0c7e-bdc9-4c13-9e1a-0b17e5801727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348b09cc-f5bb-4b93-90ab-8309bae3ba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348b09cc-f5bb-4b93-90ab-8309bae3ba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-375457867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3b380f-3f91-4618-b112-97778239f375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b8fb67e2334d35ba36d220e9e6d04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb1fc58f-324c-4a1c-b350-174ebe63b138,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:51Z,use_quota=True,user_id='e2141bc581c04649b30185da62266577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532b4e2f-b79c-4524-b926-31bcfb3968ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532b4e2f-b79c-4524-b926-31bcfb3968ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b5537a-d98a-4720-9d62-7dda88c749d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b5537a-d98a-4720-9d62-7dda88c749d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d3b380f-3f91-4618-b112-97778239f375', 'volume_name': 'volume-8d3b380f-3f91-4618-b112-97778239f375', 'volume_size': 1, 'snapshot_id': 'bb1fc58f-324c-4a1c-b350-174ebe63b138'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6f9792-c7a3-45f9-a232-5ce78cd1be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6f9792-c7a3-45f9-a232-5ce78cd1be3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0250b6a4-4966-4204-9173-55945876f5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Volume 8d3b380f-3f91-4618-b112-97778239f375: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d3b380f-3f91-4618-b112-97778239f375', 'volume_size': 1, 'snapshot_id': 'bb1fc58f-324c-4a1c-b350-174ebe63b138'} Aug 25 06:59:50 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 0.671s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:50 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f Aug 25 06:59:50 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Flow 'volume_create_manager' (5376810c-e832-4db0-85db-3834fc830023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c0e1d0-ac29-48da-919d-b58f43fd3d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c0e1d0-ac29-48da-919d-b58f43fd3d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440179241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9a08e1d-afa6-4bd8-ab48-4e38d6b26a51,host='devstack@QuobyteHD#QuobyteHD',id=2690e27d-3121-4e2a-a119-457adadb0d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06c019d49ef4934b388c60260a4f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:52Z,use_quota=True,user_id='6092dffb69cc44c39aa35960ac80120a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53a839b2-ef18-4541-a8e7-40f75eb6a522),volume_type_id=53a839b2-ef18-4541-a8e7-40f75eb6a522)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f2f0a5-c4f0-4708-9f1a-7283af4a520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f2f0a5-c4f0-4708-9f1a-7283af4a520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fdabf1-f112-4222-b635-fccc890d59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fdabf1-f112-4222-b635-fccc890d59f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2690e27d-3121-4e2a-a119-457adadb0d30', 'volume_name': 'volume-2690e27d-3121-4e2a-a119-457adadb0d30', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2b8726-1e42-481a-81f7-540eff1b2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2b8726-1e42-481a-81f7-540eff1b2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f861bc-56c2-4844-83e8-72f08cd2a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Volume 2690e27d-3121-4e2a-a119-457adadb0d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2690e27d-3121-4e2a-a119-457adadb0d30', 'volume_size': 1} Aug 25 06:59:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:55 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f" returned: 0 in 5.066s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:55 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:59:55 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Converted 1024.00 MB image at 202.09 MB/s Aug 25 06:59:55 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f is being set with open permissions: ugo+rw Aug 25 06:59:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:55 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f Aug 25 06:59:55 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:56 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f" returned: 0 in 0.240s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" released by "_copy_volume_from_snapshot" :: held 6.552s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448-b42eefe9-0a12-49f7-8a59-7339a5ff648f" released by "_create_volume_from_snapshot" :: held 6.649s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.687s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.325s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138-8d3b380f-3f91-4618-b112-97778239f375" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138-8d3b380f-3f91-4618-b112-97778239f375" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Creating volume 8d3b380f-3f91-4618-b112-97778239f375 from snapshot bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d634fa-25c6-41cb-87a9-7ad325f50721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f', 'volume_size': 2, 'snapshot_id': 'bd5c656d-abad-4983-acd4-242c6932f448'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c675f14-60b4-4069-a2ee-b3eb0270141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] snapshot: bb1fc58f-324c-4a1c-b350-174ebe63b138, volume: 8d3b380f-3f91-4618-b112-97778239f375, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:59:56 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Volume volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f (b42eefe9-0a12-49f7-8a59-7339a5ff648f): created successfully Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c675f14-60b4-4069-a2ee-b3eb0270141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (dd6b4cc8-5278-4793-8c09-d4b41087427b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0e8d0d94-d4fb-41ff-9913-4f38d2424340 tempest-VolumesSnapshotTestJSON-181853129 None] Created volume successfully. Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b63b417-341a-4c20-9315-1b8129376416]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:56 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 06:59:56 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-b42eefe9-0a12-49f7-8a59-7339a5ff648f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-b42eefe9-0a12-49f7-8a59-7339a5ff648f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3a3c61-7ce0-4eac-b2f7-ff55a0c75c7b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:56 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff60d9-23f9-4245-9edf-4de799cc077c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:56 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f Aug 25 06:59:56 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:56 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 06:59:56 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:57 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f" returned: 0 in 0.409s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:57 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:57 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f Aug 25 06:59:57 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:57 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 Aug 25 06:59:57 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:57 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b42eefe9-0a12-49f7-8a59-7339a5ff648f" returned: 0 in 0.340s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-b42eefe9-0a12-49f7-8a59-7339a5ff648f" released by "delete_volume" :: held 0.801s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['089376c7-1340-46a0-a8fb-df31cd354131', '42adf13e-0b54-463d-a6de-439f174d7c81', '374b0bed-38a5-4752-8c23-33621fa4322d', '2d63f821-846c-40e5-b3fe-47abd1e3c563'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:57 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 06:59:57 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:58 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.391s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Deleted volume successfully. Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-18ef8a90-bf5d-412c-920f-57e761af37a6 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-b42eefe9-0a12-49f7-8a59-7339a5ff648f-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (ca05d6cc-1546-4ad4-9eef-118f0ad3f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff01a9-4ae7-4a9a-9894-ae3389534c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff01a9-4ae7-4a9a-9894-ae3389534c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1455650729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a622feea-fa24-4325-8612-9eeb9f42b889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:58Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28e3b9d-a0e1-47d2-88b3-329040b699bc),volume_type_id=b28e3b9d-a0e1-47d2-88b3-329040b699bc)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd47eb10-7d53-4994-96fd-bccd2cb46b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd47eb10-7d53-4994-96fd-bccd2cb46b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eef6bcd-a65b-4f03-abf7-7b8c42dea945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eef6bcd-a65b-4f03-abf7-7b8c42dea945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a622feea-fa24-4325-8612-9eeb9f42b889', 'volume_name': 'volume-a622feea-fa24-4325-8612-9eeb9f42b889', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058540a5-1707-4876-ab0b-6e22acf40817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058540a5-1707-4876-ab0b-6e22acf40817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133812da-cc7f-442d-88ad-0a1304c04c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:58 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume a622feea-fa24-4325-8612-9eeb9f42b889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a622feea-fa24-4325-8612-9eeb9f42b889', 'volume_size': 1} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-bd5c656d-abad-4983-acd4-242c6932f448-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-bd5c656d-abad-4983-acd4-242c6932f448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" acquired by "delete_snapshot" :: waited 0.077s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Deleting offline snapshot bd5c656d-abad-4983-acd4-242c6932f448 of volume 9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] snapshot_file for this snap is: volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c7325b-6701-4035-b44f-9272ba5f0d22]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:59 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 06:59:59 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (454e6d38-ff99-49d0-b656-a74847340cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f889d0-f2f8-485e-aae5-fa4546ce725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f889d0-f2f8-485e-aae5-fa4546ce725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-327220461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d197d75-b2a8-401a-a1dd-0a7cd3883874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:59Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d11f05d-d446-4b41-ac76-93c1ba6f7c0c),volume_type_id=7d11f05d-d446-4b41-ac76-93c1ba6f7c0c)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2791cd3-fb22-476d-bd6f-cd922d920865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2791cd3-fb22-476d-bd6f-cd922d920865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac16b6-aae3-4c57-a9f5-28568b7a59e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac16b6-aae3-4c57-a9f5-28568b7a59e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d197d75-b2a8-401a-a1dd-0a7cd3883874', 'volume_name': 'volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fc3caf-18be-4481-ba40-a1afc22b9264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fc3caf-18be-4481-ba40-a1afc22b9264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b000d-0415-4662-89eb-9b37266e574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:59 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume 9d197d75-b2a8-401a-a1dd-0a7cd3883874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874', 'volume_size': 1} Aug 25 06:59:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:00 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 1.293s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9363e74b-aa26-4242-afd0-27c9488f4d41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[59193a66-789a-4f48-8fe4-1fb56cf04cc8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:00 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 07:00:00 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:00 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:00 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (3b8c2f66-d0c1-4a98-8656-23f57ad01eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72dad65-09a7-42aa-b936-f8c9790b8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72dad65-09a7-42aa-b936-f8c9790b8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1376826843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf379d-7c83-47d6-a526-cbea54f21237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:01Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67739e38-72cc-40d7-bc82-8621a3cccff8),volume_type_id=67739e38-72cc-40d7-bc82-8621a3cccff8)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3662606a-58d3-4df5-9341-3707e37b6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3662606a-58d3-4df5-9341-3707e37b6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e781f38-6e55-49e4-aab6-659b0267098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:00:01 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.713s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:00:01 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 1.202s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:01 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 07:00:01 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e781f38-6e55-49e4-aab6-659b0267098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdbf379d-7c83-47d6-a526-cbea54f21237', 'volume_name': 'volume-fdbf379d-7c83-47d6-a526-cbea54f21237', 'volume_size': 1, 'image_id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1752131944', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b75f469ecf9e4ec8a6846709c24a91a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'created_at': datetime.datetime(2026, 8, 25, 4, 59, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db3e225-7666-4c9b-901e-1ff8736d472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db3e225-7666-4c9b-901e-1ff8736d472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e99e59-23c1-4d76-97ee-f2981923fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume fdbf379d-7c83-47d6-a526-cbea54f21237: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdbf379d-7c83-47d6-a526-cbea54f21237', 'volume_size': 1, 'image_id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1752131944', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b75f469ecf9e4ec8a6846709c24a91a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'created_at': datetime.datetime(2026, 8, 25, 4, 59, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c/file', 'properties': {}}, 'image_service': } Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Trying to clone fdbf379d-7c83-47d6-a526-cbea54f21237 from image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:00:02 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 0.733s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:02 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448 Aug 25 07:00:02 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:02 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41.bd5c656d-abad-4983-acd4-242c6932f448" returned: 0 in 0.621s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-bd5c656d-abad-4983-acd4-242c6932f448" released by "_delete_snapshot" :: held 4.089s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" released by "delete_snapshot" :: held 4.141s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:03 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375" returned: 0 in 5.810s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:00:03 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Converted 1024.00 MB image at 176.23 MB/s Aug 25 07:00:03 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 is being set with open permissions: ugo+rw Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:03 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 Aug 25 07:00:03 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['9b3391c4-38a5-4e07-828a-9ff133333ac1', 'b8e9ee59-8ae6-4462-b391-c7cfc142d4c7', '6c8b89c6-f1eb-4f15-8cb8-5e1ff668fe69', 'c3367422-acd9-4d51-b404-f2c9d721652d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Delete snapshot completed successfully. Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-340dc3a0-d5d7-49fc-bcc3-b20a92144358 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-bd5c656d-abad-4983-acd4-242c6932f448-delete_snapshot" released by "delete_snapshot" :: held 4.418s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:03 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" released by "_copy_volume_from_snapshot" :: held 7.105s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138-8d3b380f-3f91-4618-b112-97778239f375" released by "_create_volume_from_snapshot" :: held 7.199s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.229s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.677s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9a08e1d-afa6-4bd8-ab48-4e38d6b26a51,created_at=2026-08-25T04:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440179241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9a08e1d-afa6-4bd8-ab48-4e38d6b26a51,host='devstack@QuobyteHD#QuobyteHD',id=2690e27d-3121-4e2a-a119-457adadb0d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06c019d49ef4934b388c60260a4f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:52Z,use_quota=True,user_id='6092dffb69cc44c39aa35960ac80120a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53a839b2-ef18-4541-a8e7-40f75eb6a522),volume_type_id=53a839b2-ef18-4541-a8e7-40f75eb6a522)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Creating volume 2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:03 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:03 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 1073741824 Aug 25 07:00:03 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0250b6a4-4966-4204-9173-55945876f5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3b380f-3f91-4618-b112-97778239f375', 'volume_size': 1, 'snapshot_id': 'bb1fc58f-324c-4a1c-b350-174ebe63b138'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d781a1b6-3b7a-404d-a096-5bd787024c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Volume volume-8d3b380f-3f91-4618-b112-97778239f375 (8d3b380f-3f91-4618-b112-97778239f375): created successfully Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d781a1b6-3b7a-404d-a096-5bd787024c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Flow 'volume_create_manager' (bf2c0c7e-bdc9-4c13-9e1a-0b17e5801727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f4303799-3843-4b57-aea8-3b4445d9739f tempest-VolumeDependencyTests-1888836171 None] Created volume successfully. Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-bb1fc58f-324c-4a1c-b350-174ebe63b138-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-9363e74b-aa26-4242-afd0-27c9488f4d41-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-9363e74b-aa26-4242-afd0-27c9488f4d41-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-bb1fc58f-324c-4a1c-b350-174ebe63b138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Deleting offline snapshot bb1fc58f-324c-4a1c-b350-174ebe63b138 of volume 8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] snapshot_file for this snap is: volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e0590c-f93a-47fe-b1f3-046b148de29d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab6cd00-8465-4c77-8fce-fa4fbefd3278]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:03 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 07:00:03 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 1073741824" returned: 0 in 0.594s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:04 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 07:00:04 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:04 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 Aug 25 07:00:04 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.532s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:04 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 0.478s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:04 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e900d9a-fd38-41fb-8888-d33d9608fd86]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:04 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41 Aug 25 07:00:04 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30" returned: 0 in 0.336s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.652s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1455650729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a622feea-fa24-4325-8612-9eeb9f42b889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:58Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28e3b9d-a0e1-47d2-88b3-329040b699bc),volume_type_id=b28e3b9d-a0e1-47d2-88b3-329040b699bc)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Creating volume a622feea-fa24-4325-8612-9eeb9f42b889 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:04 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f861bc-56c2-4844-83e8-72f08cd2a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2690e27d-3121-4e2a-a119-457adadb0d30', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:04 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 1073741824 Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a072980-27f2-4eb7-b3bd-8249f7540811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:04 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Volume volume-2690e27d-3121-4e2a-a119-457adadb0d30 (2690e27d-3121-4e2a-a119-457adadb0d30): created successfully Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a072980-27f2-4eb7-b3bd-8249f7540811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Flow 'volume_create_manager' (5376810c-e832-4db0-85db-3834fc830023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c296b9c2-8237-432c-9269-42171f08be8b tempest-GroupSnapshotsV319Test-1508353052 None] Created volume successfully. Aug 25 07:00:04 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 07:00:04 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9363e74b-aa26-4242-afd0-27c9488f4d41" returned: 0 in 0.279s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-9363e74b-aa26-4242-afd0-27c9488f4d41" released by "delete_volume" :: held 0.827s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['bf509361-00c5-4cc8-b586-5fcd8f87614e', '3221f7fd-37c5-45f6-86a4-3719e39675cf', '1f365cd2-b4f2-401b-8913-19820c14ce49', 'c3ef6ae4-967c-41bc-af6d-3b044206303d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:04 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:04 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:04 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 1073741824" returned: 0 in 0.572s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:05 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.690s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:05 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 Aug 25 07:00:05 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:05 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 07:00:05 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:05 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.358s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Deleted volume successfully. Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c1d30b22-5fd0-4773-a4fc-ec9dd82645f2 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-9363e74b-aa26-4242-afd0-27c9488f4d41-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:05 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889" returned: 0 in 0.470s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:05 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.531s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-327220461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d197d75-b2a8-401a-a1dd-0a7cd3883874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:59Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d11f05d-d446-4b41-ac76-93c1ba6f7c0c),volume_type_id=7d11f05d-d446-4b41-ac76-93c1ba6f7c0c)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Creating volume 9d197d75-b2a8-401a-a1dd-0a7cd3883874 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.471s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:05 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 1073741824 Aug 25 07:00:05 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133812da-cc7f-442d-88ad-0a1304c04c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a622feea-fa24-4325-8612-9eeb9f42b889', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138 Aug 25 07:00:05 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1339d3-3999-4ed6-abab-63eac512745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume volume-a622feea-fa24-4325-8612-9eeb9f42b889 (a622feea-fa24-4325-8612-9eeb9f42b889): created successfully Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1339d3-3999-4ed6-abab-63eac512745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (ca05d6cc-1546-4ad4-9eef-118f0ad3f586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (e11f6798-211e-4ed8-8ef3-a4aa710d3d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565541c4-6a7c-4439-8495-f4b4b1a741b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565541c4-6a7c-4439-8495-f4b4b1a741b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695209290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e17920-1e98-43bc-9efa-7f953200f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:06Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee29103-5ba2-4b24-ba91-6a2db001730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee29103-5ba2-4b24-ba91-6a2db001730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59746b00-3d45-4a19-b279-78a7b4faf281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59746b00-3d45-4a19-b279-78a7b4faf281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e17920-1e98-43bc-9efa-7f953200f0da', 'volume_name': 'volume-a8e17920-1e98-43bc-9efa-7f953200f0da', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6d9ad-3713-49d9-b87e-2aedb32bd266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6d9ad-3713-49d9-b87e-2aedb32bd266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df08a0-e424-401c-a558-30cc336aa18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Volume a8e17920-1e98-43bc-9efa-7f953200f0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e17920-1e98-43bc-9efa-7f953200f0da', 'volume_size': 1} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c3017859-65fc-4316-aeb7-c84c66ba3b69 tempest-TestInstancesWithCinderVolumes-762960962 None] Created volume successfully. Aug 25 07:00:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] GroupSnapshot 51d1ba4a-cf07-406f-808a-016327c4772c: creating. Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Group snapshot 51d1ba4a-cf07-406f-808a-016327c4772c: creating. {{(pid=94487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:05 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129.bb1fc58f-324c-4a1c-b350-174ebe63b138" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-bb1fc58f-324c-4a1c-b350-174ebe63b138" released by "_delete_snapshot" :: held 2.144s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" released by "delete_snapshot" :: held 2.174s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:05 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Created reservations ['b99de345-ad01-47a5-b089-e63086c83eb9', '336f5814-7c9a-4304-9622-bc43751c1574', 'bd414a5b-3a4f-42e2-8c86-c66e74feb265', 'aeebbbc3-7238-4930-ba97-590fe7750d89'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Delete snapshot completed successfully. Aug 25 07:00:06 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 1073741824" returned: 0 in 0.544s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-52655e69-3936-4eaf-a32b-5c1cf599f57e tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-bb1fc58f-324c-4a1c-b350-174ebe63b138-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:06 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 Aug 25 07:00:06 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:06 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874" returned: 0 in 0.260s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695209290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e17920-1e98-43bc-9efa-7f953200f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:06Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Creating volume a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:06 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b000d-0415-4662-89eb-9b37266e574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:06 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da 1073741824 Aug 25 07:00:06 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152571ec-545d-4093-a658-d0f9f77a62d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 (9d197d75-b2a8-401a-a1dd-0a7cd3883874): created successfully Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152571ec-545d-4093-a658-d0f9f77a62d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (454e6d38-ff99-49d0-b656-a74847340cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-98c71548-be66-4a12-8ed5-85128cb6f8d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Created volume successfully. Aug 25 07:00:06 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da 1073741824" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:06 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:06 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-8426f5fa-3c49-444e-bc7f-a3fbe54ec129-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-8426f5fa-3c49-444e-bc7f-a3fbe54ec129-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[21064395-0b64-4154-904b-49a63da04266]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:07 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 07:00:07 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:07 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.296s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.337s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df08a0-e424-401c-a558-30cc336aa18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e17920-1e98-43bc-9efa-7f953200f0da', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046eb322-cb0c-444d-96ae-e49fb4d672b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Creating offline snapshot 555d7920-d43f-489f-b936-1da4e7355dd7 of volume 2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:00:07 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Volume volume-a8e17920-1e98-43bc-9efa-7f953200f0da (a8e17920-1e98-43bc-9efa-7f953200f0da): created successfully Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046eb322-cb0c-444d-96ae-e49fb4d672b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (e11f6798-211e-4ed8-8ef3-a4aa710d3d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5977e831-c440-48df-a5c2-1bc59564b710]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-616e552d-801b-46a7-bd35-54179f275562 tempest-VolumesSnapshotTestJSON-181853129 None] Created volume successfully. Aug 25 07:00:07 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 Aug 25 07:00:07 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:07 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.397s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:07 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129 Aug 25 07:00:07 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:07 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30" returned: 0 in 0.404s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:07 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 1G Aug 25 07:00:07 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:07 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8426f5fa-3c49-444e-bc7f-a3fbe54ec129" released by "delete_volume" :: held 0.798s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Created reservations ['64368154-ce4a-46af-9207-325f7d7ef953', '974f7235-0f5e-4584-b7b4-bbcd220e5280', 'a9aa085c-fa17-4c74-bd6e-f6676c8f018d', '8c75f7f2-73f9-4173-991d-1967af1343d9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:08 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-8d3b380f-3f91-4618-b112-97778239f375-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-8d3b380f-3f91-4618-b112-97778239f375-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:08 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 1G" returned: 0 in 0.550s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2690e27d-3121-4e2a-a119-457adadb0d30 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:08 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2690e27d-3121-4e2a-a119-457adadb0d30 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 Aug 25 07:00:08 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fe428-61cc-41f1-a3b0-964061da8a8d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Deleted volume successfully. Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e1883ed-4927-4bad-b04a-ee3b60306830 tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-8426f5fa-3c49-444e-bc7f-a3fbe54ec129-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD, size 20.69 MB, duration 6.10 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:00:08 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Image download 20.69 MB at 3.39 MB/s Aug 25 07:00:08 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 Aug 25 07:00:08 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c0082-0e77-4b63-b753-a4404597fcd2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2690e27d-3121-4e2a-a119-457adadb0d30 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7" returned: 0 in 0.324s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD Aug 25 07:00:08 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 Aug 25 07:00:08 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375" returned: 0 in 0.422s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375 Aug 25 07:00:08 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Temporary image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c is fetched for user d32c7cabe7ea45c0881717941f9dd5aa. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:00:08 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:08 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info Aug 25 07:00:08 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[49725e2a-1c9a-4ffd-8554-ac4bc9713d90]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:09 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8d3b380f-3f91-4618-b112-97778239f375" returned: 0 in 0.305s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-quobyte-8d3b380f-3f91-4618-b112-97778239f375" released by "delete_volume" :: held 0.780s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:09 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD Aug 25 07:00:09 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Created reservations ['53237539-df4b-402d-8f63-a59ac29401a7', '0c15017c-918a-42cd-851c-acebf33472bb', '1f18e5d2-9c21-410c-86dc-5f246a3640da', '4626243d-d188-490d-b9bd-75777195d63e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:09 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:09 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:09 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:09 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info Aug 25 07:00:09 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:09 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:09 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.287s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Deleted volume successfully. Aug 25 07:00:09 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.info" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2d41d35f-f388-440d-94c9-729941e4aede tempest-VolumeDependencyTests-1888836171 None] Lock "cinder-8d3b380f-3f91-4618-b112-97778239f375-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.573s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Creating offline snapshot c61830ec-1358-4c2d-bb74-d8c775dcab8c of volume a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e018be-e9b4-479f-860d-df4f71bdd8dc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cba8310b-934d-47e9-a607-95b7bf4a3a0d tempest-GroupSnapshotsV319Test-1508353052 None] group_snapshot 51d1ba4a-cf07-406f-808a-016327c4772c: created successfully Aug 25 07:00:09 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:09 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:09 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.438s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:09 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c 1G Aug 25 07:00:09 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:10 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c 1G" returned: 0 in 0.499s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e17920-1e98-43bc-9efa-7f953200f0da -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:10 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e17920-1e98-43bc-9efa-7f953200f0da -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:10 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] group_snapshot 51d1ba4a-cf07-406f-808a-016327c4772c: deleting Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] group_snapshot 51d1ba4a-cf07-406f-808a-016327c4772c: deleting {{(pid=94487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "cinder-quobyte-555d7920-d43f-489f-b936-1da4e7355dd7" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-555d7920-d43f-489f-b936-1da4e7355dd7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Deleting offline snapshot 555d7920-d43f-489f-b936-1da4e7355dd7 of volume 2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] snapshot_file for this snap is: volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a06a3e-68c8-4a26-abff-89cf7e2bdc16]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:10 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 Aug 25 07:00:10 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:10 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e17920-1e98-43bc-9efa-7f953200f0da -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.425s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:10 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c is being set with open permissions: ugo+rw Aug 25 07:00:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:10 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:10 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7" returned: 0 in 0.436s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2690e27d-3121-4e2a-a119-457adadb0d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[da091a4b-249b-4b6a-94d4-2797473b38cd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.303s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info Aug 25 07:00:11 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 Aug 25 07:00:11 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info" returned: 0 in 0.283s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info is being set with open permissions: ugo+rw Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info Aug 25 07:00:11 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30" returned: 0 in 0.411s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 Aug 25 07:00:11 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.info" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1376826843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf379d-7c83-47d6-a526-cbea54f21237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75f469ecf9e4ec8a6846709c24a91a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:01Z,use_quota=True,user_id='d32c7cabe7ea45c0881717941f9dd5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67739e38-72cc-40d7-bc82-8621a3cccff8),volume_type_id=67739e38-72cc-40d7-bc82-8621a3cccff8)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Creating volume fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:11 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1073741824 Aug 25 07:00:11 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-04b2eb9b-4cf6-4da8-9545-1674681b8da7 tempest-VolumesSnapshotTestJSON-181853129 None] Create snapshot completed successfully Aug 25 07:00:11 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:12 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7 Aug 25 07:00:12 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:12 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30.555d7920-d43f-489f-b936-1da4e7355dd7" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-555d7920-d43f-489f-b936-1da4e7355dd7" released by "_delete_snapshot" :: held 1.693s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" released by "delete_snapshot" :: held 1.724s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:12 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1073741824" returned: 0 in 0.568s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:12 devstack cinder-volume[94487]: WARNING cinder.quota [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-220859906 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-220859906, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:00:12 devstack cinder-volume[94487]: WARNING cinder.quota [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-220859906 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-220859906, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:12 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 Aug 25 07:00:12 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] Created reservations ['fe338b9d-7ffc-40f4-8a10-55598713be04', 'a5b89f36-a80d-43f4-bc47-78953cc930b2', 'f862a8d3-c15d-41a4-b316-7e79f35d764a', 'f6398226-358c-49fa-b8e8-7d5f20226f3d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b3fec031-975f-4a41-bf3e-6ce001ee2045 tempest-GroupSnapshotsV319Test-1508353052 None] group_snapshot 51d1ba4a-cf07-406f-808a-016327c4772c: deleted successfully Aug 25 07:00:12 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Attempting download of bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c ((None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}])) to volume fdbf379d-7c83-47d6-a526-cbea54f21237. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (c224b5ba-c259-45aa-9c18-41fcb7592cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b02342-4fd1-4802-a805-0c2a7ca8bced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b02342-4fd1-4802-a805-0c2a7ca8bced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-674224210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22b8611-92e7-4c18-af99-2b473aa814e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1934673e07f2464c969fea747e18b16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c61830ec-1358-4c2d-bb74-d8c775dcab8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:13Z,use_quota=True,user_id='a1d52c426cec4294a04ed5c8e3befc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c24f92-79c8-439b-bc00-0d54821fb405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c24f92-79c8-439b-bc00-0d54821fb405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baa3bd2-1fb6-4d02-82d7-8472b11ec73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baa3bd2-1fb6-4d02-82d7-8472b11ec73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a22b8611-92e7-4c18-af99-2b473aa814e5', 'volume_name': 'volume-a22b8611-92e7-4c18-af99-2b473aa814e5', 'volume_size': 1, 'snapshot_id': 'c61830ec-1358-4c2d-bb74-d8c775dcab8c'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad30134b-e3a7-4dfa-945f-a9e4450163d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad30134b-e3a7-4dfa-945f-a9e4450163d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a169290c-0309-4c54-9b11-5162f7d7060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Volume a22b8611-92e7-4c18-af99-2b473aa814e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a22b8611-92e7-4c18-af99-2b473aa814e5', 'volume_size': 1, 'snapshot_id': 'c61830ec-1358-4c2d-bb74-d8c775dcab8c'} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[82904b1d-9093-429d-b181-c0cc3277979b]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c-a22b8611-92e7-4c18-af99-2b473aa814e5" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c-a22b8611-92e7-4c18-af99-2b473aa814e5" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Creating volume a22b8611-92e7-4c18-af99-2b473aa814e5 from snapshot c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] snapshot: c61830ec-1358-4c2d-bb74-d8c775dcab8c, volume: a22b8611-92e7-4c18-af99-2b473aa814e5, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d960b8-0cd2-4cc3-8651-307a6f79e222]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb Aug 25 07:00:13 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" acquired by "delete_volume" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c35a6ed-1959-4050-b868-90c72c741fba]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:13 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 Aug 25 07:00:13 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb Aug 25 07:00:13 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.522s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e17920-1e98-43bc-9efa-7f953200f0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee0a61-36b1-47d3-9027-6ddd00d2f055]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30" returned: 0 in 0.576s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:13 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30 Aug 25 07:00:13 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:13 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:13 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb" returned: 1 in 0.489s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_st1g4pdb' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb6914-ea64-4cca-9400-118cf7949952]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:14 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD Aug 25 07:00:14 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:14 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2690e27d-3121-4e2a-a119-457adadb0d30" returned: 0 in 0.326s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Lock "cinder-quobyte-2690e27d-3121-4e2a-a119-457adadb0d30" released by "delete_volume" :: held 0.993s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:14 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.538s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:14 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 Aug 25 07:00:14 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Created reservations ['fffa0cb0-f9ef-49ee-8309-d3c75106fd13'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:14 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:14 devstack cinder-volume[94487]: WARNING cinder.quota [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-220859906 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-220859906, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:00:14 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 Aug 25 07:00:14 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Created reservations ['87ff1cfb-a416-423d-b87b-81d6c9f6588a', 'b38880da-ba10-4dfe-b9e7-29db2b606817', '9248ecb7-62a0-4852-9a84-277b1ac0ac44', 'a60066d4-2e83-4f43-b1cc-051c0cc2bdff'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:14 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:14 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:14 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:14 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-42eb967d-a0bd-4593-b532-90e7d7221c5e tempest-GroupSnapshotsV319Test-1508353052 None] Delete group completed successfully. Aug 25 07:00:18 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237" returned: 0 in 4.169s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:18 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c_znp7kmyudevstack@QuobyteHD, size 112.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:00:18 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Converted 112.00 MB image at 26.86 MB/s Aug 25 07:00:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:18 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1G Aug 25 07:00:18 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:19 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 1G" returned: 0 in 0.901s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Downloaded image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c ((None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}])) to volume fdbf379d-7c83-47d6-a526-cbea54f21237 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Temporary image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c for user d32c7cabe7ea45c0881717941f9dd5aa is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Marking volume fdbf379d-7c83-47d6-a526-cbea54f21237 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Copying metadata from image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c to fdbf379d-7c83-47d6-a526-cbea54f21237. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Creating volume glance metadata for volume fdbf379d-7c83-47d6-a526-cbea54f21237 backed by image bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c with: {'image_id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'image_name': 'tempest-scenario-img--1752131944', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e99e59-23c1-4d76-97ee-f2981923fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbf379d-7c83-47d6-a526-cbea54f21237', 'volume_size': 1, 'image_id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1752131944', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b75f469ecf9e4ec8a6846709c24a91a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c', 'created_at': datetime.datetime(2026, 8, 25, 4, 59, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc8c650c-d4e6-4ea8-ab24-09c82dd55f0c/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8965ec1-eb0f-4d5f-8987-39e26a04212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Volume volume-fdbf379d-7c83-47d6-a526-cbea54f21237 (fdbf379d-7c83-47d6-a526-cbea54f21237): created successfully Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8965ec1-eb0f-4d5f-8987-39e26a04212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Flow 'volume_create_manager' (3b8c2f66-d0c1-4a98-8656-23f57ad01eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e509369d-22f6-4b75-9182-e085a0f2aed9 tempest-TestInstancesWithCinderVolumes-762960962 None] Created volume successfully. Aug 25 07:00:20 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5" returned: 0 in 6.221s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:00:20 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Converted 1024.00 MB image at 164.55 MB/s Aug 25 07:00:20 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 is being set with open permissions: ugo+rw Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:20 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 Aug 25 07:00:20 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:20 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5" returned: 0 in 0.319s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" released by "_copy_volume_from_snapshot" :: held 7.766s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c-a22b8611-92e7-4c18-af99-2b473aa814e5" released by "_create_volume_from_snapshot" :: held 7.867s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.896s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a169290c-0309-4c54-9b11-5162f7d7060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22b8611-92e7-4c18-af99-2b473aa814e5', 'volume_size': 1, 'snapshot_id': 'c61830ec-1358-4c2d-bb74-d8c775dcab8c'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaa4297-e223-4f18-86d4-33b8afe9df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Volume volume-a22b8611-92e7-4c18-af99-2b473aa814e5 (a22b8611-92e7-4c18-af99-2b473aa814e5): created successfully Aug 25 07:00:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaa4297-e223-4f18-86d4-33b8afe9df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Flow 'volume_create_manager' (c224b5ba-c259-45aa-9c18-41fcb7592cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7e457928-c219-4bd4-8a91-7fea78693176 tempest-VolumesSnapshotTestJSON-181853129 None] Created volume successfully. Aug 25 07:00:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-a22b8611-92e7-4c18-af99-2b473aa814e5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-a22b8611-92e7-4c18-af99-2b473aa814e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f731975-4da5-4861-afb9-6e9a46fcaa87]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:22 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 Aug 25 07:00:22 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:22 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5" returned: 0 in 0.488s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:22 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5 Aug 25 07:00:22 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:23 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a22b8611-92e7-4c18-af99-2b473aa814e5" returned: 0 in 0.396s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a22b8611-92e7-4c18-af99-2b473aa814e5" released by "delete_volume" :: held 0.963s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['d55fddb7-5cf1-4a4a-9583-4973e6cc6768', 'c5dd7c47-fed3-4c81-8456-d23289b02feb', 'b70554e7-acf3-4404-9d10-7692a102efff', 'e70f2583-be91-4401-962d-76baa20eb781'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:23 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:23 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:23 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Deleted volume successfully. Aug 25 07:00:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-981545e6-17ba-4d50-8af3-a0df0da5db80 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-a22b8611-92e7-4c18-af99-2b473aa814e5-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-c61830ec-1358-4c2d-bb74-d8c775dcab8c-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-c61830ec-1358-4c2d-bb74-d8c775dcab8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Deleting offline snapshot c61830ec-1358-4c2d-bb74-d8c775dcab8c of volume a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] snapshot_file for this snap is: volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c1e69-f7c1-4693-bb63-647a91252d6e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:24 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:24 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:25 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.632s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e17920-1e98-43bc-9efa-7f953200f0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50da263-9c13-48d6-828e-488f07c75dab]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-311c57a0-483e-4e16-a63c-5671f376abdc tempest-GroupsV320Test-620352939 None] Group tempest-GroupsV320Test-Group-512506316: creating Aug 25 07:00:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-311c57a0-483e-4e16-a63c-5671f376abdc tempest-GroupsV320Test-620352939 None] Group tempest-GroupsV320Test-Group-512506316: created successfully Aug 25 07:00:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-311c57a0-483e-4e16-a63c-5671f376abdc tempest-GroupsV320Test-620352939 None] Create group completed successfully. Aug 25 07:00:25 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:25 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a98ef3f8-3737-4c17-9b1d-6225cc2c40f8 req-b6bd7186-fdff-4534-808f-b6e98a4b26d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a98ef3f8-3737-4c17-9b1d-6225cc2c40f8 req-b6bd7186-fdff-4534-808f-b6e98a4b26d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-a98ef3f8-3737-4c17-9b1d-6225cc2c40f8 req-b6bd7186-fdff-4534-808f-b6e98a4b26d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-a98ef3f8-3737-4c17-9b1d-6225cc2c40f8 req-b6bd7186-fdff-4534-808f-b6e98a4b26d4 tempest-TestInstancesWithCinderVolumes-762960962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-fdbf379d-7c83-47d6-a526-cbea54f21237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bec28c4a-ff91-4e7d-b101-33274b026668', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:00:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-a98ef3f8-3737-4c17-9b1d-6225cc2c40f8 req-b6bd7186-fdff-4534-808f-b6e98a4b26d4 tempest-TestInstancesWithCinderVolumes-762960962 None] attachment_update completed successfully. Aug 25 07:00:25 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.728s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:26 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:26 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:26 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.697s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:26 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c Aug 25 07:00:26 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Created reservations ['d53789b4-639d-428c-bfa5-13d6ac30211e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:27 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da.c61830ec-1358-4c2d-bb74-d8c775dcab8c" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:27 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:27 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c61830ec-1358-4c2d-bb74-d8c775dcab8c" released by "_delete_snapshot" :: held 2.733s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" released by "delete_snapshot" :: held 2.768s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['a87f6640-9061-4bce-bb73-900d28f0732a', 'aae2a9e3-a353-497a-a030-414e9af66138', '793dcf0e-bad0-47e5-8c2e-f13a47aa8049', '3ede2a08-53f1-4eef-a674-223c96effc1b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Delete snapshot completed successfully. Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-29e8780e-e841-44cc-bba4-3a4f34ebba3d tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-c61830ec-1358-4c2d-bb74-d8c775dcab8c-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:27 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.326s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-dd03725b-d442-42a1-a401-d9a2de77d6ee tempest-GroupsV320Test-620352939 None] Delete group completed successfully. Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-a8e17920-1e98-43bc-9efa-7f953200f0da-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-a8e17920-1e98-43bc-9efa-7f953200f0da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0fe74b-abbf-401c-8dba-6658774cf2ca]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:28 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:28 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:28 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.590s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:28 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da Aug 25 07:00:28 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:28 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a8e17920-1e98-43bc-9efa-7f953200f0da" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-a8e17920-1e98-43bc-9efa-7f953200f0da" released by "delete_volume" :: held 1.030s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:28 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['2c418b51-3a7a-49b4-9c36-b1f42125cce5', '41459a6f-d535-4ad0-b9d0-482534722257', 'cca5a831-44cd-4d68-a492-7d410a06ef09', 'e4d083a9-c2d5-475e-b6fc-295caa3bf0f9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:29 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:29 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:29 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.394s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Deleted volume successfully. Aug 25 07:00:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d23e474c-02f0-49d8-b8a4-b749d1c50f09 tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-a8e17920-1e98-43bc-9efa-7f953200f0da-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ec665-fdea-4ba4-9c12-250d04b8ebef]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:30 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 Aug 25 07:00:30 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:31 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" returned: 0 in 0.790s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:31 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5 Aug 25 07:00:31 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:31 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" returned: 0 in 0.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-quobyte-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5" released by "delete_volume" :: held 1.330s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Created reservations ['bb0eb1c1-e141-4030-9d0e-d37ce7e35472', '46054283-607a-48e6-9a3c-645605ae0315', '752f4deb-2476-4b0c-a129-9c66d692748f', '63e8ba55-409a-40e4-89ee-3420b5d2fa86'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:32 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:00:32 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:32 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.363s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Deleted volume successfully. Aug 25 07:00:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-556d4719-1900-49cf-a671-b4143f35161b tempest-VolumesSnapshotTestJSON-181853129 None] Lock "cinder-c80e5b15-926e-4fcf-aa9b-c7342fc65ec5-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:00:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=154,cinder:INSERT=39,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=128,cinder:UPDATE=152,cinder:INSERT=39,cinder:DELETE=12 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:46 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Flow 'volume_create_manager' (47fa095e-ad4b-4e31-9d9e-64c7b3596412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403b0685-dead-40e2-983b-47c27a7175e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403b0685-dead-40e2-983b-47c27a7175e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1850715529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c6688d-88f9-4266-8435-fdd77aaf10b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d682ccb34c3243519803c5a38933e2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:47Z,use_quota=True,user_id='d7ccfbc89a1347b5b60f3248c880e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425c0ed8-184d-4e92-881b-0fafc6dc624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425c0ed8-184d-4e92-881b-0fafc6dc624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8789178-bcf0-4e22-9350-ec3a7f8b9c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8789178-bcf0-4e22-9350-ec3a7f8b9c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c6688d-88f9-4266-8435-fdd77aaf10b9', 'volume_name': 'volume-29c6688d-88f9-4266-8435-fdd77aaf10b9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bfd54-7dc5-4a09-b10e-605b5bfe4fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bfd54-7dc5-4a09-b10e-605b5bfe4fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4b9066-7cee-4309-b757-230bf9379dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Volume 29c6688d-88f9-4266-8435-fdd77aaf10b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c6688d-88f9-4266-8435-fdd77aaf10b9', 'volume_size': 1} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1850715529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c6688d-88f9-4266-8435-fdd77aaf10b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d682ccb34c3243519803c5a38933e2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:47Z,use_quota=True,user_id='d7ccfbc89a1347b5b60f3248c880e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Creating volume 29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:47 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:47 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 1073741824 Aug 25 07:00:47 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:48 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 1073741824" returned: 0 in 0.983s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:48 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:00:48 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:48 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.479s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4b9066-7cee-4309-b757-230bf9379dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c6688d-88f9-4266-8435-fdd77aaf10b9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa12f3-11e4-4514-852a-0c1cbd14be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Volume volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 (29c6688d-88f9-4266-8435-fdd77aaf10b9): created successfully Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa12f3-11e4-4514-852a-0c1cbd14be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Flow 'volume_create_manager' (47fa095e-ad4b-4e31-9d9e-64c7b3596412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-541684ec-dd37-4357-88d1-a05bd70edea0 tempest-SnapshotDependencyTests-2013995563 None] Created volume successfully. Aug 25 07:00:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Creating offline snapshot b914751f-b5b2-4259-bb90-aec57b0ceee4 of volume 29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:00:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112aa45-3a84-4d14-9f65-6bab1b9e7195]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:49 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:00:49 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:50 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.579s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:50 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 1G Aug 25 07:00:50 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Flow 'volume_create_manager' (bc8a6cb7-e6d8-4313-9a60-0f8018bb9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ab6ef5-0b96-45df-8810-01b9f5545dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ab6ef5-0b96-45df-8810-01b9f5545dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1717233415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d6b6a9-6c3d-47f8-989c-cccea584e972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d7f12894dd42919543065a79bb5344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:50Z,use_quota=True,user_id='5e7dc81385d5401ebd2d40d2cacafed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56596512-2f5a-4ce8-b50d-bb244773888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56596512-2f5a-4ce8-b50d-bb244773888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e0ac75-fcc0-4b52-b18e-1775491afd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e0ac75-fcc0-4b52-b18e-1775491afd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d6b6a9-6c3d-47f8-989c-cccea584e972', 'volume_name': 'volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e20858f-7b85-4bf4-beea-c768540d4503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e20858f-7b85-4bf4-beea-c768540d4503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91581738-105c-4533-96c0-2d881eab45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Volume e5d6b6a9-6c3d-47f8-989c-cccea584e972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972', 'volume_size': 1} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:50 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 1G" returned: 0 in 0.684s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:51 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:00:51 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:51 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:51 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 is being set with open permissions: ugo+rw Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:51 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:00:51 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:51 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:51 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info Aug 25 07:00:51 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:51 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info" returned: 0 in 0.334s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:51 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info is being set with open permissions: ugo+rw Aug 25 07:00:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:52 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info Aug 25 07:00:52 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:52 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.info" returned: 0 in 0.343s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1717233415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d6b6a9-6c3d-47f8-989c-cccea584e972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d7f12894dd42919543065a79bb5344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:50Z,use_quota=True,user_id='5e7dc81385d5401ebd2d40d2cacafed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Creating volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:52 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 1073741824 Aug 25 07:00:52 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3dff27f9-1190-4607-96e0-275eede2c302 tempest-SnapshotDependencyTests-2013995563 None] Create snapshot completed successfully Aug 25 07:00:52 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 1073741824" returned: 0 in 0.565s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:53 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 Aug 25 07:00:53 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:53 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972" returned: 0 in 0.292s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91581738-105c-4533-96c0-2d881eab45ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d587a6-abd3-446d-ac88-3720f7e7bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Volume volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 (e5d6b6a9-6c3d-47f8-989c-cccea584e972): created successfully Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d587a6-abd3-446d-ac88-3720f7e7bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Flow 'volume_create_manager' (bc8a6cb7-e6d8-4313-9a60-0f8018bb9b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-33a23d02-4d0d-4ef3-b8e8-6464cbc8ccb6 tempest-VolumesSnapshotListTestJSON-2091246330 None] Created volume successfully. Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Flow 'volume_create_manager' (f8e5b2b9-8cdc-4966-b134-982437b23f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbba6ed-f38e-439a-834b-49b3c7359143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbba6ed-f38e-439a-834b-49b3c7359143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dc1c04-d2ac-4809-8c03-bde5d86aa262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d682ccb34c3243519803c5a38933e2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b914751f-b5b2-4259-bb90-aec57b0ceee4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:53Z,use_quota=True,user_id='d7ccfbc89a1347b5b60f3248c880e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb797f-ad8d-4a2a-8da3-8cc53f995d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb797f-ad8d-4a2a-8da3-8cc53f995d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcbdea3-e00e-4fb8-ba54-04f6aa7aee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcbdea3-e00e-4fb8-ba54-04f6aa7aee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84dc1c04-d2ac-4809-8c03-bde5d86aa262', 'volume_name': 'volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262', 'volume_size': 1, 'snapshot_id': 'b914751f-b5b2-4259-bb90-aec57b0ceee4'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fbdbd0-9939-4e0b-a5b0-51fa1d563389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fbdbd0-9939-4e0b-a5b0-51fa1d563389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed88fce-ad1c-4909-b7ff-63ee7811ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Volume 84dc1c04-d2ac-4809-8c03-bde5d86aa262: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262', 'volume_size': 1, 'snapshot_id': 'b914751f-b5b2-4259-bb90-aec57b0ceee4'} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4-84dc1c04-d2ac-4809-8c03-bde5d86aa262" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4-84dc1c04-d2ac-4809-8c03-bde5d86aa262" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Creating volume 84dc1c04-d2ac-4809-8c03-bde5d86aa262 from snapshot b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] snapshot: b914751f-b5b2-4259-bb90-aec57b0ceee4, volume: 84dc1c04-d2ac-4809-8c03-bde5d86aa262, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[12777a01-4654-41bf-a3d2-44ac99c33044]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:53 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:00:53 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:54 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.400s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c6688d-88f9-4266-8435-fdd77aaf10b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9b7c7-9b22-4a37-b0c6-76f04a5afdad]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:54 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:00:54 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:54 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.480s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:00:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:54 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 Aug 25 07:00:54 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:59 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262" returned: 0 in 5.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:59 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:00:59 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Converted 1024.00 MB image at 193.18 MB/s Aug 25 07:00:59 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 is being set with open permissions: ugo+rw Aug 25 07:00:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:00 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 Aug 25 07:01:00 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:00 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" released by "_copy_volume_from_snapshot" :: held 6.614s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4-84dc1c04-d2ac-4809-8c03-bde5d86aa262" released by "_create_volume_from_snapshot" :: held 6.692s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.709s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.684s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Creating offline snapshot fa671976-3bb1-469e-8ba3-1134ddb19c29 of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed88fce-ad1c-4909-b7ff-63ee7811ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262', 'volume_size': 1, 'snapshot_id': 'b914751f-b5b2-4259-bb90-aec57b0ceee4'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa75594-c307-4873-bb4c-a96aaa969271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6473a1-2458-43c0-881a-e2c9635c9abf]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:00 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Volume volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 (84dc1c04-d2ac-4809-8c03-bde5d86aa262): created successfully Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa75594-c307-4873-bb4c-a96aaa969271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Flow 'volume_create_manager' (f8e5b2b9-8cdc-4966-b134-982437b23f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-559e3f7e-7c5b-429d-afee-f0cc87738244 tempest-SnapshotDependencyTests-2013995563 None] Created volume successfully. Aug 25 07:01:00 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 Aug 25 07:01:00 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:00 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:00 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:00 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972" returned: 0 in 0.472s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:00 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 1G Aug 25 07:01:00 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:01 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:01:01 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 1G" returned: 0 in 0.478s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:01 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:01 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-b914751f-b5b2-4259-bb90-aec57b0ceee4-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-b914751f-b5b2-4259-bb90-aec57b0ceee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Deleting offline snapshot b914751f-b5b2-4259-bb90-aec57b0ceee4 of volume 29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] snapshot_file for this snap is: volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08999d-ae92-47ee-8589-d6d1f9c4b481]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:01 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:01:01 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:01 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.359s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:01 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 is being set with open permissions: ugo+rw Aug 25 07:01:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:01 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:01 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:02 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.408s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c6688d-88f9-4266-8435-fdd77aaf10b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:02 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.279s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efce36d-78e5-495c-a3c9-d997780e8c45]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:02 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info Aug 25 07:01:02 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:02 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:01:02 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:02 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:02 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info is being set with open permissions: ugo+rw Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:02 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info Aug 25 07:01:02 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:02 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.info" returned: 0 in 0.274s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:02 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.612s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:02 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:01:02 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d4c0623e-3099-459b-a227-1102ec1f856f tempest-VolumesSnapshotListTestJSON-2091246330 None] Create snapshot completed successfully Aug 25 07:01:03 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.382s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:03 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4 Aug 25 07:01:03 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:03 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9.b914751f-b5b2-4259-bb90-aec57b0ceee4" returned: 0 in 0.321s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-b914751f-b5b2-4259-bb90-aec57b0ceee4" released by "_delete_snapshot" :: held 1.866s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" released by "delete_snapshot" :: held 1.894s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Created reservations ['505d461c-9132-4f72-83e5-7b70eefdfe54', 'b721896e-c0b4-4d1e-9719-a59c658766e0', '6de6bd21-b517-4eb0-93c6-ea28779c775a', '823b5cf1-b515-48ba-89fb-f31ef6ae26c0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Delete snapshot completed successfully. Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b626abb5-64d9-4d26-8c8a-e114b8162276 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-b914751f-b5b2-4259-bb90-aec57b0ceee4-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Creating offline snapshot c8571189-9596-47cd-8382-274df6431cef of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-29c6688d-88f9-4266-8435-fdd77aaf10b9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df96bc-b3c6-4fa6-82e0-729b2abd979e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-29c6688d-88f9-4266-8435-fdd77aaf10b9-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" acquired by "delete_volume" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:03 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:03 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-855b37ec-6ec5-41b8-8949-f1b5e12c2bae req-8c00cbd6-b6b7-45f4-b581-5d810b4a7d3d tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ae6c1-2c97-4cd1-935c-92cdd0930fba]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:01:04 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.491s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef 1G Aug 25 07:01:04 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.430s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9 Aug 25 07:01:04 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-29c6688d-88f9-4266-8435-fdd77aaf10b9" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-29c6688d-88f9-4266-8435-fdd77aaf10b9" released by "delete_volume" :: held 0.849s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:04 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef 1G" returned: 0 in 0.523s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:04 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Created reservations ['4f6574b4-7f99-43fd-9a57-19c7d30027b2', '7023ee63-e385-40d1-8c92-d262c23a3191', '84ec6730-25aa-4ae5-8448-7938aba771ed', '6faf5dea-3463-4c6a-86f1-eac1731af6cc'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:04 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef is being set with open permissions: ugo+rw Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:05 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.279s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Deleted volume successfully. Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f0fa9b40-468d-4531-81fc-bbe7059b6911 tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-29c6688d-88f9-4266-8435-fdd77aaf10b9-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-84dc1c04-d2ac-4809-8c03-bde5d86aa262-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-84dc1c04-d2ac-4809-8c03-bde5d86aa262-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Flow 'volume_create_manager' (84359a10-c06d-49c0-a6c3-b7397cbf83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71ad612-768c-4fdf-84ed-f4ef526946ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09ad8b-d93c-463c-bd16-88bb8c350889]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71ad612-768c-4fdf-84ed-f4ef526946ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1513077436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbe92c1-5848-4d51-b2a0-573ab727a8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ef50a3dee44c4181e66676bcd6dbba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:05Z,use_quota=True,user_id='4b7ded6166a945a380ae78bc33150891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649f729-b75e-410c-9699-8cf6d56b5fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649f729-b75e-410c-9699-8cf6d56b5fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd8b7c6-ef4b-48e7-9708-10d460afc792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd8b7c6-ef4b-48e7-9708-10d460afc792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbe92c1-5848-4d51-b2a0-573ab727a8ed', 'volume_name': 'volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6e45c9-cbe8-46ea-bbb2-3e90c34ff171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6e45c9-cbe8-46ea-bbb2-3e90c34ff171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490839fe-0fde-479c-9809-1a88c67c7739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:05 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Volume efbe92c1-5848-4d51-b2a0-573ab727a8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed', 'volume_size': 1} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-855b37ec-6ec5-41b8-8949-f1b5e12c2bae req-8c00cbd6-b6b7-45f4-b581-5d810b4a7d3d tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.555s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-855b37ec-6ec5-41b8-8949-f1b5e12c2bae req-8c00cbd6-b6b7-45f4-b581-5d810b4a7d3d tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1513077436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbe92c1-5848-4d51-b2a0-573ab727a8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ef50a3dee44c4181e66676bcd6dbba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:05Z,use_quota=True,user_id='4b7ded6166a945a380ae78bc33150891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Creating volume efbe92c1-5848-4d51-b2a0-573ab727a8ed {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:05 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:05 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:05 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed 1073741824 Aug 25 07:01:05 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-bc058520-bb3d-4189-a5be-4991c52a8efa tempest-VolumesSnapshotListTestJSON-2091246330 None] Create snapshot completed successfully Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-855b37ec-6ec5-41b8-8949-f1b5e12c2bae req-8c00cbd6-b6b7-45f4-b581-5d810b4a7d3d tempest-TestInstancesWithCinderVolumes-762960962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-a622feea-fa24-4325-8612-9eeb9f42b889', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bff6fc1-7cf6-4256-9eaa-2d872c33292e', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:01:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-855b37ec-6ec5-41b8-8949-f1b5e12c2bae req-8c00cbd6-b6b7-45f4-b581-5d810b4a7d3d tempest-TestInstancesWithCinderVolumes-762960962 None] attachment_update completed successfully. Aug 25 07:01:05 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262" returned: 0 in 0.433s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262 Aug 25 07:01:05 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed 1073741824" returned: 0 in 0.524s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:06 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed Aug 25 07:01:06 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-84dc1c04-d2ac-4809-8c03-bde5d86aa262" returned: 0 in 0.314s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-quobyte-84dc1c04-d2ac-4809-8c03-bde5d86aa262" released by "delete_volume" :: held 0.840s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Created reservations ['a20cdc1b-0e58-4d1e-a243-65472092595e', 'af314520-56e3-4582-ab20-037b853fd995', 'c26ac5ee-f47e-4100-a517-da07bfc22909', 'd99dcdad-3e07-4d9f-ba7f-961da4ca4e5a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:06 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:06 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed" returned: 0 in 0.453s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490839fe-0fde-479c-9809-1a88c67c7739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5368de4a-9ab6-4cc3-a2ed-d697735ecdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Creating offline snapshot 22fc8762-2cbe-4486-a5f8-cb2cab1ec335 of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7504945-b1db-4eb7-97ea-a9c3ed890cd4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Volume volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed (efbe92c1-5848-4d51-b2a0-573ab727a8ed): created successfully Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5368de4a-9ab6-4cc3-a2ed-d697735ecdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Flow 'volume_create_manager' (84359a10-c06d-49c0-a6c3-b7397cbf83c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ecad2d0d-f1ec-4830-98ec-df0b3f609979 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Created volume successfully. Aug 25 07:01:06 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.369s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:06 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:06 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Deleted volume successfully. Aug 25 07:01:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-94c37bfa-bfc9-4aa8-9f1a-595374475e6d tempest-SnapshotDependencyTests-2013995563 None] Lock "cinder-84dc1c04-d2ac-4809-8c03-bde5d86aa262-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:07 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.427s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:07 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 1G Aug 25 07:01:07 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:07 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 1G" returned: 0 in 0.735s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:07 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 Aug 25 07:01:07 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:08 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335" returned: 0 in 0.386s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:08 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 is being set with open permissions: ugo+rw Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-eda591ae-ea42-4c8d-8cb6-646774fa518e req-0d731d2f-91fe-485b-b233-6a8194213b39 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:08 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 Aug 25 07:01:08 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:08 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335" returned: 0 in 0.277s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-eda591ae-ea42-4c8d-8cb6-646774fa518e req-0d731d2f-91fe-485b-b233-6a8194213b39 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.322s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-eda591ae-ea42-4c8d-8cb6-646774fa518e req-0d731d2f-91fe-485b-b233-6a8194213b39 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c6e5975f-4f54-43f2-85e7-855f18afcaca tempest-VolumesSnapshotListTestJSON-2091246330 None] Create snapshot completed successfully Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-eda591ae-ea42-4c8d-8cb6-646774fa518e req-0d731d2f-91fe-485b-b233-6a8194213b39 tempest-TestInstancesWithCinderVolumes-762960962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d4bc47f-bc04-4ad5-b9a0-185ffe9c8f6e', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:01:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-eda591ae-ea42-4c8d-8cb6-646774fa518e req-0d731d2f-91fe-485b-b233-6a8194213b39 tempest-TestInstancesWithCinderVolumes-762960962 None] attachment_update completed successfully. Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Acquiring lock "cinder-efbe92c1-5848-4d51-b2a0-573ab727a8ed-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "cinder-efbe92c1-5848-4d51-b2a0-573ab727a8ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Acquiring lock "cinder-quobyte-efbe92c1-5848-4d51-b2a0-573ab727a8ed" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "cinder-quobyte-efbe92c1-5848-4d51-b2a0-573ab727a8ed" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89dfcc-c294-46af-a476-38c1bd42af69]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:09 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed Aug 25 07:01:09 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:09 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed" returned: 0 in 0.543s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:09 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed Aug 25 07:01:09 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:09 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-efbe92c1-5848-4d51-b2a0-573ab727a8ed" returned: 0 in 0.355s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "cinder-quobyte-efbe92c1-5848-4d51-b2a0-573ab727a8ed" released by "delete_volume" :: held 0.973s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-22fc8762-2cbe-4486-a5f8-cb2cab1ec335-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-22fc8762-2cbe-4486-a5f8-cb2cab1ec335-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" acquired by "delete_snapshot" :: waited 0.054s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-22fc8762-2cbe-4486-a5f8-cb2cab1ec335" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Created reservations ['17ddf610-f0fb-47c8-852c-3df71ef0834a', '4cac0553-75e7-4297-8ffa-650a9414ec5e', '13b9bc17-d9e8-4371-9f35-ed91b15cf574', '44f37015-21ca-422f-9022-26c5b8900911'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-22fc8762-2cbe-4486-a5f8-cb2cab1ec335" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Deleting offline snapshot 22fc8762-2cbe-4486-a5f8-cb2cab1ec335 of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] snapshot_file for this snap is: volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b24a3c-c809-4172-90b0-99df89de48e1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:10 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:10 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:10 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 Aug 25 07:01:10 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:10 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Deleted volume successfully. Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2cd0116a-385c-4dca-b2f4-236565013904 tempest-VolumeQuotasNegativeTestJSON-1504940452 None] Lock "cinder-efbe92c1-5848-4d51-b2a0-573ab727a8ed-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:10 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bae865-b1c0-4471-aeeb-b776342a3b5d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:10 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:10 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:10 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:11 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 Aug 25 07:01:11 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:11 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335" returned: 0 in 0.657s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:11 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335 Aug 25 07:01:11 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:12 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.22fc8762-2cbe-4486-a5f8-cb2cab1ec335" returned: 0 in 0.397s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-22fc8762-2cbe-4486-a5f8-cb2cab1ec335" released by "_delete_snapshot" :: held 1.993s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" released by "delete_snapshot" :: held 2.040s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Created reservations ['ffe040ab-7e2e-4577-9b3c-83613f7b5e3e', '3dd56162-2e38-4ec1-9c78-e04e90d64e43', 'b36acf84-35d8-4e44-9e63-161e25addd59', '3de624bb-6e28-470f-a88d-26dc77d46c53'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Delete snapshot completed successfully. Aug 25 07:01:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd35d0d5-658a-4992-9cd2-b9a1bc5ac7fc tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-22fc8762-2cbe-4486-a5f8-cb2cab1ec335-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-c8571189-9596-47cd-8382-274df6431cef-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-c8571189-9596-47cd-8382-274df6431cef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-c8571189-9596-47cd-8382-274df6431cef" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-c8571189-9596-47cd-8382-274df6431cef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Deleting offline snapshot c8571189-9596-47cd-8382-274df6431cef of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] snapshot_file for this snap is: volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b351e-2e90-49fb-9431-2b7e0a360dec]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:13 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:13 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:13 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.491s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70e6df-66c3-425e-8c34-895f90713607]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:14 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:14 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:14 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.435s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:14 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:14 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:14 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.534s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:14 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef Aug 25 07:01:14 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-a384218d-0c7d-4a50-b1c7-41aab65ffd83 req-3dec2e63-7acc-460e-9a51-caee3e0dc9db tempest-TestInstancesWithCinderVolumes-762960962 None] Terminate volume connection completed successfully. Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-a384218d-0c7d-4a50-b1c7-41aab65ffd83 req-3dec2e63-7acc-460e-9a51-caee3e0dc9db tempest-TestInstancesWithCinderVolumes-762960962 None] Deleting attachment 5bff6fc1-7cf6-4256-9eaa-2d872c33292e. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:01:15 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.c8571189-9596-47cd-8382-274df6431cef" returned: 0 in 0.306s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-c8571189-9596-47cd-8382-274df6431cef" released by "_delete_snapshot" :: held 1.913s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" released by "delete_snapshot" :: held 1.938s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Created reservations ['f29692ca-ca78-449c-93cf-c6c7a53f3105', 'd6b68f5f-c202-411f-8ed8-6fc2e4fef093', '351a80ea-de60-44ce-8bd2-8822b0988d36', '75a20277-7629-455f-bf85-4dca992afe9a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Delete snapshot completed successfully. Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8cff93b3-6814-4338-91aa-8b7264814d23 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-c8571189-9596-47cd-8382-274df6431cef-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-fa671976-3bb1-469e-8ba3-1134ddb19c29-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-fa671976-3bb1-469e-8ba3-1134ddb19c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-fa671976-3bb1-469e-8ba3-1134ddb19c29" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-fa671976-3bb1-469e-8ba3-1134ddb19c29" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Deleting offline snapshot fa671976-3bb1-469e-8ba3-1134ddb19c29 of volume e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] snapshot_file for this snap is: volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f31c9-7e4a-455e-9c13-3111912e0a6b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-a622feea-fa24-4325-8612-9eeb9f42b889-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-a622feea-fa24-4325-8612-9eeb9f42b889-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:15 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-quobyte-a622feea-fa24-4325-8612-9eeb9f42b889" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:15 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-a622feea-fa24-4325-8612-9eeb9f42b889" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce291877-25d9-4422-a7c9-ac3247507828]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 Aug 25 07:01:16 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:16 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.630s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9eddcc-115c-4b7d-accd-73df3302715c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889" returned: 0 in 0.527s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889 Aug 25 07:01:16 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:16 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 Aug 25 07:01:16 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:16 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a622feea-fa24-4325-8612-9eeb9f42b889" returned: 0 in 0.309s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-a622feea-fa24-4325-8612-9eeb9f42b889" released by "delete_volume" :: held 0.910s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:16 devstack cinder-volume[94487]: WARNING cinder.quota [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-306254970-1000326595 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-306254970-1000326595, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:16 devstack cinder-volume[94487]: WARNING cinder.quota [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-306254970-1000326595 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-306254970-1000326595, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:16 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972" returned: 0 in 0.515s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Created reservations ['16ca668c-b765-4ca4-b1c9-c2451e37b4c2', '458651b8-4d58-4a6e-b554-e6f6a1c547f1', '8acfc1ae-dfd3-49cd-940f-0c028fd60836', '0421c599-9874-4a75-9e92-fb0434691185'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:16 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:16 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:17 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:17 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:17 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Deleted volume successfully. Aug 25 07:01:17 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.665s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ea8eaf46-6b1c-4849-afad-2476a32706e3 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-a622feea-fa24-4325-8612-9eeb9f42b889-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:17 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29 Aug 25 07:01:17 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:17 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972.fa671976-3bb1-469e-8ba3-1134ddb19c29" returned: 0 in 0.379s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-fa671976-3bb1-469e-8ba3-1134ddb19c29" released by "_delete_snapshot" :: held 2.341s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" released by "delete_snapshot" :: held 2.370s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:17 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Created reservations ['457a97fb-a11d-482a-80e1-6c1c52995d17', '7d78c426-81c0-4299-9af1-2c423346ba50', '199e8d1b-4c4e-4336-ae9f-69793c0ed6e9', 'ad8dfb3a-cd5a-49e4-9264-8d80054a799c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Delete snapshot completed successfully. Aug 25 07:01:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b86b267-55c3-436a-b66b-970dd50365d2 tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-fa671976-3bb1-469e-8ba3-1134ddb19c29-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-e5d6b6a9-6c3d-47f8-989c-cccea584e972-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-e5d6b6a9-6c3d-47f8-989c-cccea584e972-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672d45a-b2d1-4320-8887-4e75a79148a3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:19 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 Aug 25 07:01:19 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:19 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972" returned: 0 in 0.440s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:19 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972 Aug 25 07:01:19 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:19 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e5d6b6a9-6c3d-47f8-989c-cccea584e972" returned: 0 in 0.498s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-quobyte-e5d6b6a9-6c3d-47f8-989c-cccea584e972" released by "delete_volume" :: held 1.028s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Created reservations ['ac9cac9e-d46e-47fe-b23f-6ff4b1a1bd08', 'a1bdad1f-365f-4778-b61e-4f7251281536', '5aa993d9-ba0a-488d-96d7-ba99775a9852', 'b83b3a30-db6f-4bd8-881e-54510bad6e31'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:20 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:20 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:20 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.314s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Deleted volume successfully. Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5e8f5bf0-e112-43ad-92ce-1d4900bf7b3c tempest-VolumesSnapshotListTestJSON-2091246330 None] Lock "cinder-e5d6b6a9-6c3d-47f8-989c-cccea584e972-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-f0e66ff9-df8e-488d-92ea-3271bae4b5ad req-6b1ded54-cf55-40f3-8c6d-668a95d53874 tempest-TestInstancesWithCinderVolumes-762960962 None] Terminate volume connection completed successfully. Aug 25 07:01:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-f0e66ff9-df8e-488d-92ea-3271bae4b5ad req-6b1ded54-cf55-40f3-8c6d-668a95d53874 tempest-TestInstancesWithCinderVolumes-762960962 None] Deleting attachment 9d4bc47f-bc04-4ad5-b9a0-185ffe9c8f6e. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-9d197d75-b2a8-401a-a1dd-0a7cd3883874-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-9d197d75-b2a8-401a-a1dd-0a7cd3883874-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-quobyte-9d197d75-b2a8-401a-a1dd-0a7cd3883874" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-9d197d75-b2a8-401a-a1dd-0a7cd3883874" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[82122070-528d-4a3f-bd4a-95114e5a1351]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:21 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 Aug 25 07:01:21 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:21 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874" returned: 0 in 0.528s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:21 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874 Aug 25 07:01:21 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:22 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9d197d75-b2a8-401a-a1dd-0a7cd3883874" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-9d197d75-b2a8-401a-a1dd-0a7cd3883874" released by "delete_volume" :: held 0.874s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:22 devstack cinder-volume[94487]: WARNING cinder.quota [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-483658344-232379672 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-483658344-232379672, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:22 devstack cinder-volume[94487]: WARNING cinder.quota [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-483658344-232379672 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-483658344-232379672, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Created reservations ['00b61a61-818b-4441-a755-d95bb66bc279', 'a885a3d1-1454-4557-8a19-e4d7194c1b20', '3b01f7b2-6519-4162-a411-bb7206550857', '8a5ae67e-db93-4eb9-8377-165272c5dc1b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:22 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:22 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:22 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Deleted volume successfully. Aug 25 07:01:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd0e3db1-5280-4a43-a95e-fd422e64cd73 tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-9d197d75-b2a8-401a-a1dd-0a7cd3883874-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Flow 'volume_create_manager' (2275f91b-1fd6-4c55-807b-19a7494f690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f5583c-743d-43d8-86f4-3d2b3ee96848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f5583c-743d-43d8-86f4-3d2b3ee96848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-705294656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ece59-cbd3-421b-a090-214201864df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64acf8abcefe4145b97c5f08e1b61529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:26Z,use_quota=True,user_id='18a13fd55f2f427b8c0143bd0207da57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d12b021-424c-4e61-a24c-473f10c8ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d12b021-424c-4e61-a24c-473f10c8ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5658b009-e4dd-4862-b515-1e5d78ab1d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5658b009-e4dd-4862-b515-1e5d78ab1d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7ece59-cbd3-421b-a090-214201864df2', 'volume_name': 'volume-9f7ece59-cbd3-421b-a090-214201864df2', 'volume_size': 2}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb9350-da6b-47cb-acc0-589ba912c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb9350-da6b-47cb-acc0-589ba912c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5524c2-c4a9-4b42-bd33-c11bd43f0668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Volume 9f7ece59-cbd3-421b-a090-214201864df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7ece59-cbd3-421b-a090-214201864df2', 'volume_size': 2} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-705294656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ece59-cbd3-421b-a090-214201864df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64acf8abcefe4145b97c5f08e1b61529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:26Z,use_quota=True,user_id='18a13fd55f2f427b8c0143bd0207da57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Creating volume 9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:25 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:01:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 2147483648 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:25 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 2147483648 Aug 25 07:01:25 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:26 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 2147483648" returned: 0 in 0.595s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:26 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 Aug 25 07:01:26 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-389f815a-618c-4a93-84fd-794969ec196c req-ba291248-f8ef-475d-8b7d-5bf3677edc89 tempest-TestInstancesWithCinderVolumes-762960962 None] Terminate volume connection completed successfully. Aug 25 07:01:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-389f815a-618c-4a93-84fd-794969ec196c req-ba291248-f8ef-475d-8b7d-5bf3677edc89 tempest-TestInstancesWithCinderVolumes-762960962 None] Deleting attachment bec28c4a-ff91-4e7d-b101-33274b026668. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:01:27 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2" returned: 0 in 0.444s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5524c2-c4a9-4b42-bd33-c11bd43f0668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7ece59-cbd3-421b-a090-214201864df2', 'volume_size': 2}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391d0865-3ff5-4c30-a13f-3b3361edb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Volume volume-9f7ece59-cbd3-421b-a090-214201864df2 (9f7ece59-cbd3-421b-a090-214201864df2): created successfully Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391d0865-3ff5-4c30-a13f-3b3361edb121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Flow 'volume_create_manager' (2275f91b-1fd6-4c55-807b-19a7494f690c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f5a6d75e-35a4-4c81-940b-892f776fcb75 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Created volume successfully. Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Flow 'volume_create_manager' (5cb57eb9-b2ec-4e8f-8483-641ae6ae2e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d095aa0a-cd55-4ac3-88c7-804c0f1e4ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d095aa0a-cd55-4ac3-88c7-804c0f1e4ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1349106542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d341e2-d9ba-491a-ad78-48b40d3b7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3db32cadf6d4894b892c7b6af0ef6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:27Z,use_quota=True,user_id='8917b01d374d44c8b16ec4023fac2c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a141d-bb8a-416c-a274-ffde3d756a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a141d-bb8a-416c-a274-ffde3d756a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8990e11a-9c4b-4f5b-9448-ccc3ee858aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8990e11a-9c4b-4f5b-9448-ccc3ee858aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d341e2-d9ba-491a-ad78-48b40d3b7344', 'volume_name': 'volume-21d341e2-d9ba-491a-ad78-48b40d3b7344', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffeb1bc5-3484-4046-a74b-6aee816baaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffeb1bc5-3484-4046-a74b-6aee816baaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51020c4e-222d-4003-99dc-77d6dbef9dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Volume 21d341e2-d9ba-491a-ad78-48b40d3b7344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d341e2-d9ba-491a-ad78-48b40d3b7344', 'volume_size': 1} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1349106542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d341e2-d9ba-491a-ad78-48b40d3b7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3db32cadf6d4894b892c7b6af0ef6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:27Z,use_quota=True,user_id='8917b01d374d44c8b16ec4023fac2c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Creating volume 21d341e2-d9ba-491a-ad78-48b40d3b7344 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:27 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:27 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 1073741824 Aug 25 07:01:27 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:27 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 1073741824" returned: 0 in 0.459s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:28 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 Aug 25 07:01:28 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:28 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344" returned: 0 in 0.244s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.260s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51020c4e-222d-4003-99dc-77d6dbef9dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d341e2-d9ba-491a-ad78-48b40d3b7344', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc563711-ba9b-406e-8a34-951324019b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Creating offline snapshot edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d of volume 9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Volume volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 (21d341e2-d9ba-491a-ad78-48b40d3b7344): created successfully Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc563711-ba9b-406e-8a34-951324019b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Flow 'volume_create_manager' (5cb57eb9-b2ec-4e8f-8483-641ae6ae2e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52655f4f-0a9d-4606-bc6c-2dd98be5c3f1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:28 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b4f73c01-5def-40fa-bee6-16b047e3b901 tempest-AbsoluteLimitsTests-1282028536 None] Created volume successfully. Aug 25 07:01:28 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 Aug 25 07:01:28 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-fdbf379d-7c83-47d6-a526-cbea54f21237-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-fdbf379d-7c83-47d6-a526-cbea54f21237-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "cinder-quobyte-fdbf379d-7c83-47d6-a526-cbea54f21237" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-fdbf379d-7c83-47d6-a526-cbea54f21237" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bdc161-cc65-4a4b-9c90-8771a8245caf]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:28 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 Aug 25 07:01:28 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:28 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2" returned: 0 in 0.361s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d 2G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:28 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d 2G Aug 25 07:01:28 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:28 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237" returned: 0 in 0.369s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:28 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237 Aug 25 07:01:28 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d 2G" returned: 0 in 0.404s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7ece59-cbd3-421b-a090-214201864df2 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7ece59-cbd3-421b-a090-214201864df2 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d Aug 25 07:01:29 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fdbf379d-7c83-47d6-a526-cbea54f21237" returned: 0 in 0.261s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-quobyte-fdbf379d-7c83-47d6-a526-cbea54f21237" released by "delete_volume" :: held 0.670s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:29 devstack cinder-volume[94487]: WARNING cinder.quota [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273684786-519444460 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273684786-519444460, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:29 devstack cinder-volume[94487]: WARNING cinder.quota [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273684786-519444460 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273684786-519444460, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Created reservations ['abd16604-5ff3-4cd4-9cf3-a08a6a831ca1', '851203bc-bba5-48b6-93ab-9f3256194d19', '0265f953-2e13-4573-9017-500971ca1d88', '75c03de0-29d8-40ce-8c26-7f4712d8c0a1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:29 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7ece59-cbd3-421b-a090-214201864df2 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" returned: 0 in 0.310s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d is being set with open permissions: ugo+rw Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d Aug 25 07:01:29 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.256s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:29 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Deleted volume successfully. Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b9f3fb7a-c254-4d41-8729-8c9913ca719f tempest-TestInstancesWithCinderVolumes-762960962 None] Lock "cinder-fdbf379d-7c83-47d6-a526-cbea54f21237-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:29 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Acquiring lock "cinder-21d341e2-d9ba-491a-ad78-48b40d3b7344-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" returned: 0 in 0.278s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "cinder-21d341e2-d9ba-491a-ad78-48b40d3b7344-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Acquiring lock "cinder-quobyte-21d341e2-d9ba-491a-ad78-48b40d3b7344" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "cinder-quobyte-21d341e2-d9ba-491a-ad78-48b40d3b7344" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:29 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info Aug 25 07:01:29 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb961e-8b2e-4d56-ac4c-0376e4c716f4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 Aug 25 07:01:29 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:30 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info" returned: 0 in 0.355s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:30 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info is being set with open permissions: ugo+rw Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:30 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info Aug 25 07:01:30 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:30 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344" returned: 0 in 0.459s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:30 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344 Aug 25 07:01:30 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:30 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.info" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1bb2b671-ec85-4e07-9670-e81e3f65da70 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Create snapshot completed successfully Aug 25 07:01:30 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21d341e2-d9ba-491a-ad78-48b40d3b7344" returned: 0 in 0.280s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "cinder-quobyte-21d341e2-d9ba-491a-ad78-48b40d3b7344" released by "delete_volume" :: held 0.793s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Created reservations ['70ecb1b7-c7c5-4d27-a794-822de65c3407', '89bc0641-5fc8-464d-9e41-7c261e0894f5', 'a606977c-21a2-4acd-afd3-e510a76c5d8a', 'ab7058c7-83da-4b28-b92e-a5c991a6df84'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:30 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:30 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:31 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Deleted volume successfully. Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f455f814-34dd-4d09-99d0-c2f7557f3342 tempest-AbsoluteLimitsTests-1282028536 None] Lock "cinder-21d341e2-d9ba-491a-ad78-48b40d3b7344-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "cinder-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "cinder-quobyte-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Deleting offline snapshot edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d of volume 9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] snapshot_file for this snap is: volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7964bb3-02d2-40be-9f15-ab7b7c6d937d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:31 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d Aug 25 07:01:31 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:31 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f7ece59-cbd3-421b-a090-214201864df2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3115bd-220b-488a-9a11-a7a56e8cddb9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:32 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 Aug 25 07:01:32 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:32 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:32 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d Aug 25 07:01:32 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:32 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" returned: 0 in 0.464s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:32 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d Aug 25 07:01:32 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:33 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2.edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" returned: 0 in 0.287s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d" released by "_delete_snapshot" :: held 1.784s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" released by "delete_snapshot" :: held 1.819s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Created reservations ['56a17958-202c-47e1-822c-c29430807e61', 'd3d91889-f528-4f32-9e2d-73bda1a00018', 'befe676a-417e-41b2-9079-af193363dc3c', 'f0ae7a50-0da6-4f5d-946f-5f10913ecba9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Delete snapshot completed successfully. Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4d041b10-0379-4f75-823d-8f6e46e896df tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-edb0caaf-c0f0-4ef8-a6f6-d4d8f494957d-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "cinder-9f7ece59-cbd3-421b-a090-214201864df2-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-9f7ece59-cbd3-421b-a090-214201864df2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e013e-3d97-40f6-89b9-8d9472cc8be8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:33 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 Aug 25 07:01:33 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:34 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2" returned: 0 in 0.414s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:34 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2 Aug 25 07:01:34 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:34 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9f7ece59-cbd3-421b-a090-214201864df2" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-quobyte-9f7ece59-cbd3-421b-a090-214201864df2" released by "delete_volume" :: held 0.765s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Created reservations ['1627e82c-5732-466b-add6-b0f98ada23ad', 'aa2aadf7-ef84-422b-a145-b33fff9a5de8', '54558b64-1f9c-4443-bbe5-bad88640f707', 'ae05a307-c553-453b-bbde-957c9d7558cc'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:34 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:34 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:35 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.464s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:35 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Deleted volume successfully. Aug 25 07:01:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f7b78ae0-6ace-4886-b791-d40fa867efe5 tempest-VolumesSnapshotNegativeTestJSON-1200438072 None] Lock "cinder-9f7ece59-cbd3-421b-a090-214201864df2-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (5f696412-b889-4e1e-a04f-1eff78da463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d30a9b-449c-4a29-a3bd-5837b2b80c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d30a9b-449c-4a29-a3bd-5837b2b80c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997469857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0891a423-6ded-413b-9907-54ecc354985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5323b8506b540ba824bb41830f92a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:36Z,use_quota=True,user_id='efbcf16ed0e041af9fd20ba21491a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869dc378-2a32-4001-b0f4-39f479142584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869dc378-2a32-4001-b0f4-39f479142584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e658d-e080-4a6c-8230-9e1159cc92aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e658d-e080-4a6c-8230-9e1159cc92aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0891a423-6ded-413b-9907-54ecc354985e', 'volume_name': 'volume-0891a423-6ded-413b-9907-54ecc354985e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893bf31a-9ba3-40c7-8c1a-b03e06b3c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893bf31a-9ba3-40c7-8c1a-b03e06b3c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba0410e-0038-437f-bcab-73461aab0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:36 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Volume 0891a423-6ded-413b-9907-54ecc354985e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0891a423-6ded-413b-9907-54ecc354985e', 'volume_size': 1} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997469857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0891a423-6ded-413b-9907-54ecc354985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5323b8506b540ba824bb41830f92a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:36Z,use_quota=True,user_id='efbcf16ed0e041af9fd20ba21491a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Creating volume 0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:36 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:01:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:36 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e 1073741824 Aug 25 07:01:36 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:37 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e 1073741824" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:37 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:37 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:37 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.276s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba0410e-0038-437f-bcab-73461aab0da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0891a423-6ded-413b-9907-54ecc354985e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4da6e37-ae50-47d7-af8e-d4b25c6f3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:37 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Volume volume-0891a423-6ded-413b-9907-54ecc354985e (0891a423-6ded-413b-9907-54ecc354985e): created successfully Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4da6e37-ae50-47d7-af8e-d4b25c6f3150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (5f696412-b889-4e1e-a04f-1eff78da463e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0f61beae-963a-48dc-b68d-1d9d7728b284 tempest-VolumesDeleteCascade-424139237 None] Created volume successfully. Aug 25 07:01:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Creating offline snapshot 5c6646c3-9fb6-4af4-a038-d5985d776ed5 of volume 0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e7b81b-4aa0-4655-92c6-78d9aa642080]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:39 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:39 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:39 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.463s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:39 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 1G Aug 25 07:01:39 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:39 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 1G" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:39 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:39 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:40 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:40 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 is being set with open permissions: ugo+rw Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:40 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:40 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:40 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:40 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info Aug 25 07:01:40 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:40 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:40 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info is being set with open permissions: ugo+rw Aug 25 07:01:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:40 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info Aug 25 07:01:40 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:41 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.info" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-24b8e48a-a633-4019-bb5c-8e2fc1eef003 tempest-VolumesDeleteCascade-424139237 None] Create snapshot completed successfully Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Creating offline snapshot 91a40eb7-29cd-4f79-ac88-230012ee1495 of volume 0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[37354c15-7171-40ad-8e4b-f712340bd4c5]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:42 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:42 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:42 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.450s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0891a423-6ded-413b-9907-54ecc354985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:42 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 1G Aug 25 07:01:42 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:43 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 1G" returned: 0 in 0.540s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:43 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:43 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:43 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.514s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:43 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 is being set with open permissions: ugo+rw Aug 25 07:01:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:43 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:43 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:44 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.298s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b45c0b86-3515-4c2e-be16-5cbca23ef6d5 tempest-VolumesDeleteCascade-424139237 None] Create snapshot completed successfully Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-0891a423-6ded-413b-9907-54ecc354985e-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-0891a423-6ded-413b-9907-54ecc354985e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Performing cascade delete. {{(pid=94487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1014}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-5c6646c3-9fb6-4af4-a038-d5985d776ed5-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-5c6646c3-9fb6-4af4-a038-d5985d776ed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-5c6646c3-9fb6-4af4-a038-d5985d776ed5" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-5c6646c3-9fb6-4af4-a038-d5985d776ed5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Deleting offline snapshot 5c6646c3-9fb6-4af4-a038-d5985d776ed5 of volume 0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] snapshot_file for this snap is: volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b3642-c5a9-4bb4-b04f-537787bb1000]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:44 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:44 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:45 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.480s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0891a423-6ded-413b-9907-54ecc354985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[821beaa3-70a9-4972-9ba3-124e5b2cd362]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:45 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:45 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:45 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[63958254-6f39-4d56-b5d0-0e7d185cd800]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:45 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:45 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:46 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.428s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0891a423-6ded-413b-9907-54ecc354985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeca7ad-8207-4f7b-bfee-9f60083ada67]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:46 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:46 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:46 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.510s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0891a423-6ded-413b-9907-54ecc354985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493c6d5-dd6f-4728-b6b5-b48009c59669]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:46 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:46 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:47 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.441s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:47 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:47 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:47 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.431s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:47 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5 Aug 25 07:01:47 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:47 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.5c6646c3-9fb6-4af4-a038-d5985d776ed5" returned: 0 in 0.305s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 -F qcow2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:47 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 -F qcow2 Aug 25 07:01:47 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:48 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0891a423-6ded-413b-9907-54ecc354985e /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 -F qcow2" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-5c6646c3-9fb6-4af4-a038-d5985d776ed5" released by "_delete_snapshot" :: held 3.636s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" released by "delete_snapshot" :: held 3.667s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=132,cinder:SELECT=118,cinder:INSERT=35,cinder:DELETE=10 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=135,cinder:UPDATE=134,cinder:DELETE=13,cinder:INSERT=32 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Created reservations ['9addd850-c87f-4d00-a5ea-17a80024bf43', '79f148d9-9797-453c-a7a2-e0155e97b24b', 'aac59bb1-c780-43ec-aa17-3ca55cc3469a', 'fb26d0d9-c47d-4d67-9da9-0f8ead9bf9a0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Delete snapshot completed successfully. Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-5c6646c3-9fb6-4af4-a038-d5985d776ed5-delete_snapshot" released by "delete_snapshot" :: held 3.892s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-91a40eb7-29cd-4f79-ac88-230012ee1495-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-91a40eb7-29cd-4f79-ac88-230012ee1495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-91a40eb7-29cd-4f79-ac88-230012ee1495" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-91a40eb7-29cd-4f79-ac88-230012ee1495" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Deleting offline snapshot 91a40eb7-29cd-4f79-ac88-230012ee1495 of volume 0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] snapshot_file for this snap is: volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[633797be-8489-4ba0-96f7-48831377ae7b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:48 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:48 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:48 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0891a423-6ded-413b-9907-54ecc354985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce27f6-77eb-4a80-babf-4feb5b9616ce]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:49 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:49 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:49 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:49 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:49 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:49 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.433s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:49 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495 Aug 25 07:01:49 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:50 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e.91a40eb7-29cd-4f79-ac88-230012ee1495" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-91a40eb7-29cd-4f79-ac88-230012ee1495" released by "_delete_snapshot" :: held 1.741s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" released by "delete_snapshot" :: held 1.764s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Created reservations ['77b539c7-f8a7-4102-a582-509e15cfec1c', 'ae5ab297-1568-49cb-bbf3-f8bacbee13db', '6a9e4791-c554-4b2f-8786-55acd7cc4041', '145107d5-e39a-4c7d-8dfa-419c81268168'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Delete snapshot completed successfully. Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-91a40eb7-29cd-4f79-ac88-230012ee1495-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Snapshots deleted, issuing volume delete {{(pid=94487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1029}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84fa42-8467-4cf5-a8cb-2da85a1e84e8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:50 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:50 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:50 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.413s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:50 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e Aug 25 07:01:50 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:51 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0891a423-6ded-413b-9907-54ecc354985e" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-0891a423-6ded-413b-9907-54ecc354985e" released by "delete_volume" :: held 0.793s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Created reservations ['773692fb-0696-4dc1-b514-6c996db088af', '6defc899-4bd2-470d-a7b8-a0822082c0ae', '2ec456a5-790c-4e0e-9a0b-5ee0a2eb5873', 'bf9900d5-995f-48cc-bd77-1d333a6feea3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:51 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:01:51 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:51 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.306s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Deleted volume successfully. Aug 25 07:01:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-113849ec-a642-4afa-a0d4-49c54173b31a tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-0891a423-6ded-413b-9907-54ecc354985e-delete_volume" released by "delete_volume" :: held 7.268s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:52 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (48b16c1d-1bb1-4b8c-ad42-ba455ff1222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a44246-e22e-4613-a0be-bde882619998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a44246-e22e-4613-a0be-bde882619998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1182377537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec803503-34cf-4fc1-8bb6-a6554fd781c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5323b8506b540ba824bb41830f92a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:53Z,use_quota=True,user_id='efbcf16ed0e041af9fd20ba21491a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75f4f75-a3aa-46c4-b44f-971d5781132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75f4f75-a3aa-46c4-b44f-971d5781132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3773fa91-de87-4b54-9cef-3977f8228813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3773fa91-de87-4b54-9cef-3977f8228813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec803503-34cf-4fc1-8bb6-a6554fd781c9', 'volume_name': 'volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a57a11-bcb5-4829-a184-6f7e8df4ebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a57a11-bcb5-4829-a184-6f7e8df4ebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9d1ecc-0e3d-4551-8987-b296e170e311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Volume ec803503-34cf-4fc1-8bb6-a6554fd781c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9', 'volume_size': 1} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1182377537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec803503-34cf-4fc1-8bb6-a6554fd781c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5323b8506b540ba824bb41830f92a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:53Z,use_quota=True,user_id='efbcf16ed0e041af9fd20ba21491a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Creating volume ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:53 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:53 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 1073741824 Aug 25 07:01:53 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:53 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 1073741824" returned: 0 in 0.712s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:53 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:01:53 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:54 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.302s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9d1ecc-0e3d-4551-8987-b296e170e311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9686415-e21a-45d8-a469-07311fe997c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Volume volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 (ec803503-34cf-4fc1-8bb6-a6554fd781c9): created successfully Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9686415-e21a-45d8-a469-07311fe997c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (48b16c1d-1bb1-4b8c-ad42-ba455ff1222a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0ea5a446-e908-4f35-ba0f-20eca0ce201b tempest-VolumesDeleteCascade-424139237 None] Created volume successfully. Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Creating offline snapshot f3d3b4ce-3f04-44d5-820d-b0a70d8af30a of volume ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ff1ad0-c20c-46fe-83c7-f99a2f4f5b18]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:55 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:01:55 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:55 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.560s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:55 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a 1G Aug 25 07:01:55 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:56 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a 1G" returned: 0 in 0.583s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:56 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:01:56 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:56 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.360s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a is being set with open permissions: ugo+rw Aug 25 07:01:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:56 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:01:56 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:57 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.306s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:57 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info Aug 25 07:01:57 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:57 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info" returned: 0 in 0.312s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:57 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info is being set with open permissions: ugo+rw Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:57 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info Aug 25 07:01:57 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:57 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.info" returned: 0 in 0.263s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-14bb5c2a-5fe5-4b9c-852e-06dbd9fe9591 tempest-VolumesDeleteCascade-424139237 None] Create snapshot completed successfully Aug 25 07:01:58 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (446b4d3c-dc53-47f0-9dfb-627b7856f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63330b49-5ed0-4542-add5-7526cca734dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63330b49-5ed0-4542-add5-7526cca734dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-256210392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff2bad8-3dee-43ee-9254-2b11f147c45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5323b8506b540ba824bb41830f92a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3d3b4ce-3f04-44d5-820d-b0a70d8af30a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:59Z,use_quota=True,user_id='efbcf16ed0e041af9fd20ba21491a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd038da-fd7e-4d51-b6e2-2683d51a1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd038da-fd7e-4d51-b6e2-2683d51a1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587438b6-fd32-47cd-bc0c-9f1fa323baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587438b6-fd32-47cd-bc0c-9f1fa323baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aff2bad8-3dee-43ee-9254-2b11f147c45b', 'volume_name': 'volume-aff2bad8-3dee-43ee-9254-2b11f147c45b', 'volume_size': 1, 'snapshot_id': 'f3d3b4ce-3f04-44d5-820d-b0a70d8af30a'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e2e33-9361-4d09-aabf-c02d2cf3f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e2e33-9361-4d09-aabf-c02d2cf3f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8b1607-7e9c-44cd-871d-827d7a55822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:59 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Volume aff2bad8-3dee-43ee-9254-2b11f147c45b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aff2bad8-3dee-43ee-9254-2b11f147c45b', 'volume_size': 1, 'snapshot_id': 'f3d3b4ce-3f04-44d5-820d-b0a70d8af30a'} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-aff2bad8-3dee-43ee-9254-2b11f147c45b" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-aff2bad8-3dee-43ee-9254-2b11f147c45b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Creating volume aff2bad8-3dee-43ee-9254-2b11f147c45b from snapshot f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] snapshot: f3d3b4ce-3f04-44d5-820d-b0a70d8af30a, volume: aff2bad8-3dee-43ee-9254-2b11f147c45b, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b3c3b0-a735-498a-90a3-ee049717ea97]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:59 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:01:59 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:59 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff6acc-afc1-4059-9f2e-b3d3c74976a2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:59 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:01:59 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:00 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:00 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b Aug 25 07:02:00 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:00 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:02:00 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:01 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.788s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:02:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:02:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:02:05 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b" returned: 0 in 5.816s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:05 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:02:05 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Converted 1024.00 MB image at 176.03 MB/s Aug 25 07:02:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b is being set with open permissions: ugo+rw Aug 25 07:02:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:05 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b Aug 25 07:02:05 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:06 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" released by "_copy_volume_from_snapshot" :: held 7.074s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-aff2bad8-3dee-43ee-9254-2b11f147c45b" released by "_create_volume_from_snapshot" :: held 7.160s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.183s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8b1607-7e9c-44cd-871d-827d7a55822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff2bad8-3dee-43ee-9254-2b11f147c45b', 'volume_size': 1, 'snapshot_id': 'f3d3b4ce-3f04-44d5-820d-b0a70d8af30a'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35422a9-7ff7-46e4-8983-17a704e8dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Volume volume-aff2bad8-3dee-43ee-9254-2b11f147c45b (aff2bad8-3dee-43ee-9254-2b11f147c45b): created successfully Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35422a9-7ff7-46e4-8983-17a704e8dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Flow 'volume_create_manager' (446b4d3c-dc53-47f0-9dfb-627b7856f604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d9efc18e-574d-4c2e-8af9-ec08096790c1 tempest-VolumesDeleteCascade-424139237 None] Created volume successfully. Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-ec803503-34cf-4fc1-8bb6-a6554fd781c9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-ec803503-34cf-4fc1-8bb6-a6554fd781c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Performing cascade delete. {{(pid=94487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1014}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Deleting offline snapshot f3d3b4ce-3f04-44d5-820d-b0a70d8af30a of volume ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] snapshot_file for this snap is: volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9e038-a5ac-4141-a54f-24c8fcff5e96]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:07 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:02:07 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:07 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc5a47-7956-4901-ad7d-6c4b6237b261]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:08 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:02:08 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:08 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.662s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:08 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:02:08 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:09 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.465s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:09 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a Aug 25 07:02:09 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:09 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9.f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" returned: 0 in 0.339s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a" released by "_delete_snapshot" :: held 2.027s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" released by "delete_snapshot" :: held 2.072s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Created reservations ['6a7d2362-e807-4143-8975-06d19ff7db12', '783b5265-b511-4374-b0f6-6ae54299f304', 'b16ccea0-33e2-41e6-bc21-5336ea3b7246', 'facd6a10-fd8b-4211-a9b1-b314cb70a7b9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Delete snapshot completed successfully. Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-f3d3b4ce-3f04-44d5-820d-b0a70d8af30a-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Snapshots deleted, issuing volume delete {{(pid=94487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1029}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[116a55ad-edfc-4ed8-9c82-a0888b27c3de]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:09 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:02:09 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:10 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.459s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:10 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9 Aug 25 07:02:10 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Flow 'volume_create_manager' (4cb72a0f-7a93-416e-a6eb-a0b4facb455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0f26f2-1ec0-401d-94c0-b72ed6d6f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0f26f2-1ec0-401d-94c0-b72ed6d6f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1544059113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31adec30-ef4c-4196-a789-5a9b92c6c463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abe83997b548fcb2bdd2506c6adeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:10Z,use_quota=True,user_id='f965eac0f1074ec1b1477f1fee0ed73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e0323c-e274-47ee-b6eb-e7a21b7360c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e0323c-e274-47ee-b6eb-e7a21b7360c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b882a065-0d0e-498d-97f4-296c33d15b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b882a065-0d0e-498d-97f4-296c33d15b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31adec30-ef4c-4196-a789-5a9b92c6c463', 'volume_name': 'volume-31adec30-ef4c-4196-a789-5a9b92c6c463', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac8992-afdd-4158-9f33-d35b5443ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac8992-afdd-4158-9f33-d35b5443ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa0f590-0e77-4a95-a40a-5c98d840ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume 31adec30-ef4c-4196-a789-5a9b92c6c463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31adec30-ef4c-4196-a789-5a9b92c6c463', 'volume_size': 1} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1544059113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31adec30-ef4c-4196-a789-5a9b92c6c463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abe83997b548fcb2bdd2506c6adeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:10Z,use_quota=True,user_id='f965eac0f1074ec1b1477f1fee0ed73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Creating volume 31adec30-ef4c-4196-a789-5a9b92c6c463 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:10 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:10 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 1073741824 Aug 25 07:02:10 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:10 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ec803503-34cf-4fc1-8bb6-a6554fd781c9" returned: 0 in 0.428s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-ec803503-34cf-4fc1-8bb6-a6554fd781c9" released by "delete_volume" :: held 0.964s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Created reservations ['16db8d1b-5b13-483e-9f5b-01e5c29887c8', 'f138c20c-9753-40f2-aec0-1a20706dc001', '56b08d39-39d7-491d-9775-2183be2b1494', '6f267933-fef1-4972-9a82-b04396318095'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Flow 'volume_create_manager' (274024ae-0c76-4aad-a221-8fac54baa18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfaec642-77a7-42f9-8759-963fc87c9dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfaec642-77a7-42f9-8759-963fc87c9dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1257328927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ad732-cf4f-4aa0-918d-528e171bd4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abe83997b548fcb2bdd2506c6adeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:11Z,use_quota=True,user_id='f965eac0f1074ec1b1477f1fee0ed73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:10 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:02:10 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a174b59a-0ddd-4d09-ac86-3f8903413566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a174b59a-0ddd-4d09-ac86-3f8903413566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588284ed-cc4c-4594-bb9d-ce52304d2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588284ed-cc4c-4594-bb9d-ce52304d2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9ad732-cf4f-4aa0-918d-528e171bd4d6', 'volume_name': 'volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff35e4c-cbcc-4597-b53f-dc5104fce4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff35e4c-cbcc-4597-b53f-dc5104fce4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3491abbf-9df1-45a0-958f-8e6431c0ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume cf9ad732-cf4f-4aa0-918d-528e171bd4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6', 'volume_size': 1} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:11 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 1073741824" returned: 0 in 0.692s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:11 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 Aug 25 07:02:11 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:11 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.382s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Deleted volume successfully. Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0f5c94bd-5b15-41f0-ad34-34df8d2b0d17 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-ec803503-34cf-4fc1-8bb6-a6554fd781c9-delete_volume" released by "delete_volume" :: held 4.157s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:11 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463" returned: 0 in 0.331s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1257328927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ad732-cf4f-4aa0-918d-528e171bd4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abe83997b548fcb2bdd2506c6adeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:11Z,use_quota=True,user_id='f965eac0f1074ec1b1477f1fee0ed73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Creating volume cf9ad732-cf4f-4aa0-918d-528e171bd4d6 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:11 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa0f590-0e77-4a95-a40a-5c98d840ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31adec30-ef4c-4196-a789-5a9b92c6c463', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66596d11-434a-4d49-9d88-0d6a0c0237bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 1073741824 Aug 25 07:02:11 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:11 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume volume-31adec30-ef4c-4196-a789-5a9b92c6c463 (31adec30-ef4c-4196-a789-5a9b92c6c463): created successfully Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66596d11-434a-4d49-9d88-0d6a0c0237bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Flow 'volume_create_manager' (4cb72a0f-7a93-416e-a6eb-a0b4facb455b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a44f3fc0-85b2-47a8-ab0e-117be78e0cd5 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Created volume successfully. Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-aff2bad8-3dee-43ee-9254-2b11f147c45b-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-aff2bad8-3dee-43ee-9254-2b11f147c45b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc95e10-4230-4248-8283-ba864039d137]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:12 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b Aug 25 07:02:12 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 1073741824" returned: 0 in 0.692s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:12 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 Aug 25 07:02:12 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:12 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b Aug 25 07:02:12 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3491abbf-9df1-45a0-958f-8e6431c0ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85c1e03-62f5-4b6d-b1a1-70fc8b78fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:12 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Volume volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 (cf9ad732-cf4f-4aa0-918d-528e171bd4d6): created successfully Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85c1e03-62f5-4b6d-b1a1-70fc8b78fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Flow 'volume_create_manager' (274024ae-0c76-4aad-a221-8fac54baa18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ac05a01b-8c86-42e5-9e37-65e9d3cdee32 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Created volume successfully. Aug 25 07:02:12 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-aff2bad8-3dee-43ee-9254-2b11f147c45b" returned: 0 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-quobyte-aff2bad8-3dee-43ee-9254-2b11f147c45b" released by "delete_volume" :: held 0.872s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Created reservations ['bdca2c89-aa38-4836-8f2d-7fa7248a87d9', 'c7cb5da1-b027-408e-bf1c-a07d35c6ecf1', '97d55062-95fd-4054-b4e0-da730c36ccdb', '77faa395-7cda-4e3f-adac-af031d792b52'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:13 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:02:13 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:13 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:13 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Deleted volume successfully. Aug 25 07:02:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ead25406-7e28-4e45-a2d1-c479bce70fe8 tempest-VolumesDeleteCascade-424139237 None] Lock "cinder-aff2bad8-3dee-43ee-9254-2b11f147c45b-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Flow 'volume_create_manager' (1818c6dc-3d72-474a-96d7-8c97826488eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9823e3-970b-4853-8343-a10005a4808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9823e3-970b-4853-8343-a10005a4808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-553461425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd023ed-490e-4edf-aa98-9ddde98839ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80d6ddeb599406295645dd5340ee1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:19Z,use_quota=True,user_id='e1af3e8780984a83b6581ef0d73cbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8258b88b-d6f4-4c33-8220-2f9a3e6db72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8258b88b-d6f4-4c33-8220-2f9a3e6db72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2912ce-5d58-4381-94ea-3c96a8869f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2912ce-5d58-4381-94ea-3c96a8869f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd023ed-490e-4edf-aa98-9ddde98839ef', 'volume_name': 'volume-dbd023ed-490e-4edf-aa98-9ddde98839ef', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b079d6-ca9b-47bb-9a9c-d2f07d2c0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b079d6-ca9b-47bb-9a9c-d2f07d2c0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9fa19b-096e-4665-8fbb-0f9770d7aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Volume dbd023ed-490e-4edf-aa98-9ddde98839ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd023ed-490e-4edf-aa98-9ddde98839ef', 'volume_size': 1} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-553461425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd023ed-490e-4edf-aa98-9ddde98839ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80d6ddeb599406295645dd5340ee1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:19Z,use_quota=True,user_id='e1af3e8780984a83b6581ef0d73cbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Creating volume dbd023ed-490e-4edf-aa98-9ddde98839ef {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:19 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:19 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef 1073741824 Aug 25 07:02:19 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:20 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef 1073741824" returned: 0 in 0.528s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:20 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef Aug 25 07:02:20 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:20 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef" returned: 0 in 0.382s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9fa19b-096e-4665-8fbb-0f9770d7aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd023ed-490e-4edf-aa98-9ddde98839ef', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb94f8-88f0-48d6-9f81-fc636adacacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Volume volume-dbd023ed-490e-4edf-aa98-9ddde98839ef (dbd023ed-490e-4edf-aa98-9ddde98839ef): created successfully Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb94f8-88f0-48d6-9f81-fc636adacacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Flow 'volume_create_manager' (1818c6dc-3d72-474a-96d7-8c97826488eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cc21454f-bbf9-4e13-b0c1-22c052609ca9 tempest-VolumesTransfersV355Test-1609751912 None] Created volume successfully. Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Flow 'volume_create_manager' (2a3e3fbd-d478-43e0-bbf9-2bac84ed4067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03baeebd-99db-465d-b98d-bad060fdeb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03baeebd-99db-465d-b98d-bad060fdeb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-441077928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74376eae69428a96b72ca395b726d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:21Z,use_quota=True,user_id='79bdb623efdd405aad9bb55a92a48082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd28390-a037-434a-ade1-9b42d1151367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd28390-a037-434a-ade1-9b42d1151367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f70aa93-9e1b-45bf-83f5-7ca22c572b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:20 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f70aa93-9e1b-45bf-83f5-7ca22c572b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'volume_name': 'volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37088e23-e145-408a-9af2-4a16274f469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37088e23-e145-408a-9af2-4a16274f469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfaa40f-2989-4053-a124-17a7849d340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Trying to clone 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:02:21 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Image download 20.69 MB at 20.69 MB/s Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19679e1-24c4-4dcc-95cf-ba2c93341da4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:21 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD Aug 25 07:02:21 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:22 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a is fetched for user 79bdb623efdd405aad9bb55a92a48082. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[38756ce6-e189-4de1-af7e-531de1e26252]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:22 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD Aug 25 07:02:22 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-eb671a13-4009-458a-b487-54364902885a tempest-VolumesTransfersV355Test-187181180 None] Transfer volume completed successfully. Aug 25 07:02:22 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-441077928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74376eae69428a96b72ca395b726d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:21Z,use_quota=True,user_id='79bdb623efdd405aad9bb55a92a48082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Creating volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:22 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:22 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1073741824 Aug 25 07:02:22 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "cinder-dbd023ed-490e-4edf-aa98-9ddde98839ef-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-dbd023ed-490e-4edf-aa98-9ddde98839ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "cinder-quobyte-dbd023ed-490e-4edf-aa98-9ddde98839ef" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-quobyte-dbd023ed-490e-4edf-aa98-9ddde98839ef" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7d76c-b8b6-416b-9f31-575bab05f9f2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:23 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1073741824" returned: 0 in 0.555s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:23 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 Aug 25 07:02:23 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:23 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef Aug 25 07:02:23 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:23 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" returned: 0 in 0.276s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Attempting download of 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:02:23 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:23 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef Aug 25 07:02:23 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853f709-9eab-41f3-a94f-e3f145d3ea6f]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:24 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix Aug 25 07:02:24 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:24 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dbd023ed-490e-4edf-aa98-9ddde98839ef" returned: 0 in 0.374s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-quobyte-dbd023ed-490e-4edf-aa98-9ddde98839ef" released by "delete_volume" :: held 0.847s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Created reservations ['1cfa6068-458d-4d16-bef5-75a5495b0071', '755e4bf8-40b8-45e6-a1c5-0269f48eb308', '1a52c73f-6b7d-47d6-9391-d28831cd8f0b', '7ac888f6-97f6-4191-aa9b-b689a7a857c2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:24 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix" returned: 0 in 0.452s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:24 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:02:24 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:24 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix Aug 25 07:02:24 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:24 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.396s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Deleted volume successfully. Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-81b917e8-0da4-48a3-a1bd-2f066da656c1 tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-dbd023ed-490e-4edf-aa98-9ddde98839ef-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:24 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix" returned: 1 in 0.540s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_v930tiix' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[22952ded-0929-4939-94f9-0d19a8fc48d7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:25 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD Aug 25 07:02:25 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:25 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a was qcow2, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:25 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 Aug 25 07:02:25 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Flow 'volume_create_manager' (0d7baa11-b97f-4377-b7e1-4e7a0ed0b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef6c9f-0030-4793-85d1-8893d9b9f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef6c9f-0030-4793-85d1-8893d9b9f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1088436901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4e619-79fa-41d5-b1ef-d67dd6251f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80d6ddeb599406295645dd5340ee1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:25Z,use_quota=True,user_id='e1af3e8780984a83b6581ef0d73cbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37167320-a83a-460d-99de-9bebfd2843e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37167320-a83a-460d-99de-9bebfd2843e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2b853-ac55-4706-bf17-8834cc89e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2b853-ac55-4706-bf17-8834cc89e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a4e619-79fa-41d5-b1ef-d67dd6251f69', 'volume_name': 'volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15790fc-6f8f-40ac-9903-48309e3e7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15790fc-6f8f-40ac-9903-48309e3e7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d750eee0-a7c1-47e2-94e5-a241217076e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Volume 67a4e619-79fa-41d5-b1ef-d67dd6251f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69', 'volume_size': 1} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1088436901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4e619-79fa-41d5-b1ef-d67dd6251f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80d6ddeb599406295645dd5340ee1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:25Z,use_quota=True,user_id='e1af3e8780984a83b6581ef0d73cbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Creating volume 67a4e619-79fa-41d5-b1ef-d67dd6251f69 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:25 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:25 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 1073741824 Aug 25 07:02:25 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:26 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 1073741824" returned: 0 in 0.695s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:26 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 Aug 25 07:02:26 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:26 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d750eee0-a7c1-47e2-94e5-a241217076e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393b796d-042e-46c4-90ac-aba44bb1d1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:26 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Volume volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 (67a4e619-79fa-41d5-b1ef-d67dd6251f69): created successfully Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393b796d-042e-46c4-90ac-aba44bb1d1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Flow 'volume_create_manager' (0d7baa11-b97f-4377-b7e1-4e7a0ed0b54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5ee44fcd-2fc0-4ef9-91e1-3ae3626256fc tempest-VolumesTransfersV355Test-1609751912 None] Created volume successfully. Aug 25 07:02:27 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" returned: 0 in 2.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a_mw4jlmsjdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:02:27 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Converted 112.00 MB image at 47.08 MB/s Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "cinder-67a4e619-79fa-41d5-b1ef-d67dd6251f69-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:27 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1G Aug 25 07:02:27 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-67a4e619-79fa-41d5-b1ef-d67dd6251f69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "cinder-quobyte-67a4e619-79fa-41d5-b1ef-d67dd6251f69" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-quobyte-67a4e619-79fa-41d5-b1ef-d67dd6251f69" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a2a47-01e5-4dc7-980a-ba68c5ae5a44]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:28 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 Aug 25 07:02:28 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:28 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 1G" returned: 0 in 0.365s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Downloaded image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a ((None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}])) to volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Temporary image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a for user 79bdb623efdd405aad9bb55a92a48082 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Marking volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Copying metadata from image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a to 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Creating volume glance metadata for volume 2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 backed by image 10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfaa40f-2989-4053-a124-17a7849d340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'volume_size': 1, 'image_id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7d849b0c3114dd8add62bf783624a71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a', 'created_at': datetime.datetime(2026, 8, 25, 4, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 43, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10205cb5-69e4-4d97-a8a0-1a8e1ac26c7a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fdfee9-8a79-4127-b426-83be342f27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Volume volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 (2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2): created successfully Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fdfee9-8a79-4127-b426-83be342f27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Flow 'volume_create_manager' (2a3e3fbd-d478-43e0-bbf9-2bac84ed4067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:28 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ec9b5383-fa45-4f23-95d7-2e8e16206bf5 tempest-TestShelveInstance-1182219359 None] Created volume successfully. Aug 25 07:02:28 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69" returned: 0 in 0.414s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:28 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69 Aug 25 07:02:28 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:28 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-67a4e619-79fa-41d5-b1ef-d67dd6251f69" returned: 0 in 0.236s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-quobyte-67a4e619-79fa-41d5-b1ef-d67dd6251f69" released by "delete_volume" :: held 0.695s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Created reservations ['ab819678-a9b4-485b-ada7-dd5f302d9ef7', 'b0fc90a8-bb3c-4a60-8ce4-11d465a01bf9', 'e1e77aba-77c6-4ca8-a927-135a766dfbb3', '72ed1403-4697-4f64-8e6f-73f32652bca1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:28 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:02:28 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:28 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.249s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:28 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Deleted volume successfully. Aug 25 07:02:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-59f83d7f-f3f4-4d9c-8c5d-38ed36550eeb tempest-VolumesTransfersV355Test-1390273979 None] Lock "cinder-67a4e619-79fa-41d5-b1ef-d67dd6251f69-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-b8a88d7b-0e80-493b-8abe-b93ad5d09375 req-a1830332-707b-4304-84cf-5ba8775cc21b tempest-TestShelveInstance-1182219359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-b8a88d7b-0e80-493b-8abe-b93ad5d09375 req-a1830332-707b-4304-84cf-5ba8775cc21b tempest-TestShelveInstance-1182219359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-b8a88d7b-0e80-493b-8abe-b93ad5d09375 req-a1830332-707b-4304-84cf-5ba8775cc21b tempest-TestShelveInstance-1182219359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-b8a88d7b-0e80-493b-8abe-b93ad5d09375 req-a1830332-707b-4304-84cf-5ba8775cc21b tempest-TestShelveInstance-1182219359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2145a4fb-ccb7-474b-9427-982ed95c3c85', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:02:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-b8a88d7b-0e80-493b-8abe-b93ad5d09375 req-a1830332-707b-4304-84cf-5ba8775cc21b tempest-TestShelveInstance-1182219359 None] attachment_update completed successfully. Aug 25 07:02:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=72,cinder:INSERT=27,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:02:44 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:02:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-0725f4d2-d204-4f46-8ca8-1e0cb08d858c req-e56079d8-c69d-42ef-af36-5980d578f19b tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-0725f4d2-d204-4f46-8ca8-1e0cb08d858c req-e56079d8-c69d-42ef-af36-5980d578f19b tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-0725f4d2-d204-4f46-8ca8-1e0cb08d858c req-e56079d8-c69d-42ef-af36-5980d578f19b tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-0725f4d2-d204-4f46-8ca8-1e0cb08d858c req-e56079d8-c69d-42ef-af36-5980d578f19b tempest-TestServerVolumeAttachmentScenario-2057805820 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-31adec30-ef4c-4196-a789-5a9b92c6c463', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec5221c5-d69b-411f-98c6-577fb75a16f5', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:02:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-0725f4d2-d204-4f46-8ca8-1e0cb08d858c req-e56079d8-c69d-42ef-af36-5980d578f19b tempest-TestServerVolumeAttachmentScenario-2057805820 None] attachment_update completed successfully. Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Flow 'volume_create_manager' (a61ec99d-20fd-48f6-8c86-ea3ff01f6291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74cbf66-4f83-42cb-a13c-4df66fd16316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74cbf66-4f83-42cb-a13c-4df66fd16316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144740477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0b877180d4e59a6ab12f1b110ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:50Z,use_quota=True,user_id='295ff36970694d4d8d2eec65a7a0f106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c2125b-f741-47e1-9212-89490c6c3edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c2125b-f741-47e1-9212-89490c6c3edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1902107e-48a3-4881-aa7d-75940603d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1902107e-48a3-4881-aa7d-75940603d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5', 'volume_name': 'volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4938242-8ffd-4b45-89ae-0579f1dcdf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4938242-8ffd-4b45-89ae-0579f1dcdf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448bcd2b-405e-48e8-83cb-a865107a4b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5', 'volume_size': 1} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144740477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0b877180d4e59a6ab12f1b110ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:50Z,use_quota=True,user_id='295ff36970694d4d8d2eec65a7a0f106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Creating volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:49 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:02:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:49 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 1073741824 Aug 25 07:02:49 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:50 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 1073741824" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:50 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:02:50 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:50 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.267s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448bcd2b-405e-48e8-83cb-a865107a4b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d28f4e-91e8-4dc6-b10d-a2221f89c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Volume volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 (4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5): created successfully Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d28f4e-91e8-4dc6-b10d-a2221f89c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Flow 'volume_create_manager' (a61ec99d-20fd-48f6-8c86-ea3ff01f6291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1f41d704-a2a2-4a76-9eb8-3cd44f4fce43 tempest-VolumesActionsTest-1239135956 None] Created volume successfully. Aug 25 07:02:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-5e6da482-9fcc-432f-88a7-ee4e26d6dc12 req-f6c76210-958d-47dc-b1ec-64809a3b8091 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-5e6da482-9fcc-432f-88a7-ee4e26d6dc12 req-f6c76210-958d-47dc-b1ec-64809a3b8091 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-5e6da482-9fcc-432f-88a7-ee4e26d6dc12 req-f6c76210-958d-47dc-b1ec-64809a3b8091 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-5e6da482-9fcc-432f-88a7-ee4e26d6dc12 req-f6c76210-958d-47dc-b1ec-64809a3b8091 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ec7a907-2222-4931-9149-afda38ceb701', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:02:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-5e6da482-9fcc-432f-88a7-ee4e26d6dc12 req-f6c76210-958d-47dc-b1ec-64809a3b8091 tempest-TestServerVolumeAttachmentScenario-2057805820 None] attachment_update completed successfully. Aug 25 07:02:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-05cc10a4-be0a-4acf-bfe1-524782564015 req-9430947a-9fc1-4224-a4b5-8713f5881879 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Terminate volume connection completed successfully. Aug 25 07:02:58 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-05cc10a4-be0a-4acf-bfe1-524782564015 req-9430947a-9fc1-4224-a4b5-8713f5881879 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Deleting attachment 4ec7a907-2222-4931-9149-afda38ceb701. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:03:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-5a062534-baec-4f3f-b04a-4aabee6e229a req-d37722e8-651e-4146-8299-a0d62b0d7c90 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Terminate volume connection completed successfully. Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-5a062534-baec-4f3f-b04a-4aabee6e229a req-d37722e8-651e-4146-8299-a0d62b0d7c90 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Deleting attachment ec5221c5-d69b-411f-98c6-577fb75a16f5. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:00 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:03:00 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:01 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.360s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:03:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:03:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e1815e8-e971-4d55-a820-9f6c957b1a2a tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" by "attach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e1815e8-e971-4d55-a820-9f6c957b1a2a tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" acquired by "attach_volume" :: waited 0.061s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2e1815e8-e971-4d55-a820-9f6c957b1a2a tempest-VolumesActionsTest-1239135956 None] Attaching volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 to instance f7e4e9df-3a33-4ce1-be50-3d0f8b23c265 at mountpoint /dev/vdb on host None. Aug 25 07:03:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2e1815e8-e971-4d55-a820-9f6c957b1a2a tempest-VolumesActionsTest-1239135956 None] Attach volume completed successfully. Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2e1815e8-e971-4d55-a820-9f6c957b1a2a tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" released by "attach_volume" :: held 0.161s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8027cc9c-e129-45c2-b0c3-9fa42b45a0d7 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" by "detach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8027cc9c-e129-45c2-b0c3-9fa42b45a0d7 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8027cc9c-e129-45c2-b0c3-9fa42b45a0d7 tempest-VolumesActionsTest-1239135956 None] Detaching volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 from instance f7e4e9df-3a33-4ce1-be50-3d0f8b23c265. Aug 25 07:03:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8027cc9c-e129-45c2-b0c3-9fa42b45a0d7 tempest-VolumesActionsTest-1239135956 None] Detach volume completed successfully. Aug 25 07:03:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8027cc9c-e129-45c2-b0c3-9fa42b45a0d7 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "cinder-cf9ad732-cf4f-4aa0-918d-528e171bd4d6-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-cf9ad732-cf4f-4aa0-918d-528e171bd4d6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "cinder-quobyte-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-quobyte-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1451013-3c55-49b1-a3b4-e8de90ac5d2f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:07 devstack sudo[110199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 Aug 25 07:03:07 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:07 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" returned: 0 in 0.393s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:07 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6 Aug 25 07:03:07 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:07 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" returned: 0 in 0.308s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-quobyte-cf9ad732-cf4f-4aa0-918d-528e171bd4d6" released by "delete_volume" :: held 0.780s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Created reservations ['28e8c389-aad8-4167-b990-b90838bea7e4', '1f9149dc-a679-492e-b2fe-7c746955bfec', 'c4fd0523-a0de-48d9-aebc-c2077c47f4c2', 'cbc6a65d-2994-4d1b-b67c-9b5c05806248'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:08 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:03:08 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "cinder-31adec30-ef4c-4196-a789-5a9b92c6c463-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-31adec30-ef4c-4196-a789-5a9b92c6c463-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "cinder-quobyte-31adec30-ef4c-4196-a789-5a9b92c6c463" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-52e0c10b-9db0-4b5a-b1bb-3917a3f47000 req-cfea58f8-6db4-4e7f-bcc8-8348db723900 tempest-TestShelveInstance-1182219359 None] Terminate volume connection completed successfully. Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-52e0c10b-9db0-4b5a-b1bb-3917a3f47000 req-cfea58f8-6db4-4e7f-bcc8-8348db723900 tempest-TestShelveInstance-1182219359 None] Deleting attachment 2145a4fb-ccb7-474b-9427-982ed95c3c85. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-quobyte-31adec30-ef4c-4196-a789-5a9b92c6c463" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e62d2b-3b27-4f16-b12e-7fcc35ffc526]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:08 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Deleted volume successfully. Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-82d5c6f3-5f1b-4c2b-9dd9-4ad93164f46f tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-cf9ad732-cf4f-4aa0-918d-528e171bd4d6-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:08 devstack sudo[110230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 Aug 25 07:03:08 devstack sudo[110230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:08 devstack sudo[110230]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:08 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463 Aug 25 07:03:08 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:09 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-31adec30-ef4c-4196-a789-5a9b92c6c463" returned: 0 in 0.268s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-quobyte-31adec30-ef4c-4196-a789-5a9b92c6c463" released by "delete_volume" :: held 0.762s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Created reservations ['66574fbf-dbbb-4b3c-97ef-71e94456dd96', '7cd68d30-986b-421c-a433-b390de27ff5e', 'dad37cf1-fe2e-4f9e-96f4-0644ca9c5e4a', 'b838f2e7-d7e8-4db9-862c-be264390c55a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:09 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:03:09 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:09 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.350s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Deleted volume successfully. Aug 25 07:03:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-218c9ecd-af90-4db6-8a7f-590d2d8b6f22 tempest-TestServerVolumeAttachmentScenario-2057805820 None] Lock "cinder-31adec30-ef4c-4196-a789-5a9b92c6c463-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-1a5b05b6-de9c-45dc-983b-ec58d63d56c9 req-aa8c1985-b575-4305-bc7b-590838d19a51 tempest-TestShelveInstance-1182219359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-1a5b05b6-de9c-45dc-983b-ec58d63d56c9 req-aa8c1985-b575-4305-bc7b-590838d19a51 tempest-TestShelveInstance-1182219359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-1a5b05b6-de9c-45dc-983b-ec58d63d56c9 req-aa8c1985-b575-4305-bc7b-590838d19a51 tempest-TestShelveInstance-1182219359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-1a5b05b6-de9c-45dc-983b-ec58d63d56c9 req-aa8c1985-b575-4305-bc7b-590838d19a51 tempest-TestShelveInstance-1182219359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11d0d80b-ce17-48f5-b927-bdd1c42fd533', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:03:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-1a5b05b6-de9c-45dc-983b-ec58d63d56c9 req-aa8c1985-b575-4305-bc7b-590838d19a51 tempest-TestShelveInstance-1182219359 None] attachment_update completed successfully. Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f5fd8adf-dccd-4a86-938d-a5b09e0229b1 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" by "attach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f5fd8adf-dccd-4a86-938d-a5b09e0229b1 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" acquired by "attach_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f5fd8adf-dccd-4a86-938d-a5b09e0229b1 tempest-VolumesActionsTest-1239135956 None] Attaching volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 to instance bbdfb879-e3ef-4644-bbf6-3a54edbc2139 at mountpoint /dev/vdb on host None. Aug 25 07:03:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f5fd8adf-dccd-4a86-938d-a5b09e0229b1 tempest-VolumesActionsTest-1239135956 None] Attach volume completed successfully. Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f5fd8adf-dccd-4a86-938d-a5b09e0229b1 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" released by "attach_volume" :: held 0.122s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c455121-aff6-46cd-81b4-24f5c9459f67 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" by "detach_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c455121-aff6-46cd-81b4-24f5c9459f67 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5c455121-aff6-46cd-81b4-24f5c9459f67 tempest-VolumesActionsTest-1239135956 None] Detaching volume 4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 from instance bbdfb879-e3ef-4644-bbf6-3a54edbc2139. Aug 25 07:03:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5c455121-aff6-46cd-81b4-24f5c9459f67 tempest-VolumesActionsTest-1239135956 None] Detach volume completed successfully. Aug 25 07:03:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5c455121-aff6-46cd-81b4-24f5c9459f67 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-detach_volume" released by "detach_volume" :: held 0.182s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:25 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd830bb-d01f-4373-8472-8ba73bf8aa71]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:25 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:03:25 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:26 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.436s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:26 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7bd5a-7f04-4c23-a8e0-fdee53d767ef]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:26 devstack sudo[110848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:03:26 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:26 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.02e156c2-d2cf-463b-acf6-3855625ed9f46n5wg2yd.img {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:26 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.02e156c2-d2cf-463b-acf6-3855625ed9f46n5wg2yd.img Aug 25 07:03:26 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:29 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=51,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:03:31 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.02e156c2-d2cf-463b-acf6-3855625ed9f46n5wg2yd.img" returned: 0 in 5.081s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb92704-e14f-4e27-bb18-f67fc5356f27]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:31 devstack sudo[110869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:03:31 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:32 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.600s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:32 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.02e156c2-d2cf-463b-acf6-3855625ed9f46n5wg2yd.img {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:03:32 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Converted 1024.00 MB image at 201.48 MB/s Aug 25 07:03:32 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] 02e156c2-d2cf-463b-acf6-3855625ed9f4 was raw, no need to convert to raw {{(pid=94487) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 25 07:03:42 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=47,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Flow 'volume_create_manager' (c5aae65d-25b6-4795-9bef-980ea28bbf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baec16f8-1474-4a17-aa7c-5e7b18d8730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baec16f8-1474-4a17-aa7c-5e7b18d8730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1806921419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571ea2c9-3860-4043-ad90-e1a27de6fc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3732314b1562435697f6fc768ed053ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:56Z,use_quota=True,user_id='67d88bae146047cda2836886b81b91e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2631652-d789-4bff-a53e-46ab7845ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2631652-d789-4bff-a53e-46ab7845ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b98a42f-cc27-4fdc-9ab6-55c02859d927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b98a42f-cc27-4fdc-9ab6-55c02859d927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571ea2c9-3860-4043-ad90-e1a27de6fc9c', 'volume_name': 'volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbab31ce-9b98-443e-8575-b30a350382a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbab31ce-9b98-443e-8575-b30a350382a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92738110-d6b0-42b3-be5f-c7d4fd5977a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:56 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Volume 571ea2c9-3860-4043-ad90-e1a27de6fc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c', 'volume_size': 1} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.671s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Uploaded volume to glance image-id: 02e156c2-d2cf-463b-acf6-3855625ed9f4. {{(pid=94487) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1806921419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571ea2c9-3860-4043-ad90-e1a27de6fc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3732314b1562435697f6fc768ed053ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:56Z,use_quota=True,user_id='67d88bae146047cda2836886b81b91e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Creating volume 571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:56 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4865dd57-f80b-4020-9d1e-113135850dee tempest-VolumesActionsTest-1239135956 None] Copy volume to image completed successfully. Aug 25 07:03:56 devstack sudo[110944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c 1073741824 Aug 25 07:03:56 devstack sudo[110944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:56 devstack sudo[110944]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c 1073741824" returned: 0 in 0.489s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:57 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:03:57 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:57 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92738110-d6b0-42b3-be5f-c7d4fd5977a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c21f8e5-e22f-4a73-8387-aac153f130d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:57 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Volume volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c (571ea2c9-3860-4043-ad90-e1a27de6fc9c): created successfully Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c21f8e5-e22f-4a73-8387-aac153f130d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Flow 'volume_create_manager' (c5aae65d-25b6-4795-9bef-980ea28bbf35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7c0c69df-3203-4594-9340-551c84e8ec42 tempest-TestStampPattern-1495504115 None] Created volume successfully. Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c18bc-231d-444e-87c3-9ae9382f5162]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:58 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:03:58 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:58 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.412s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc6760-71f4-4f52-99bd-15f68517b72e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:59 devstack sudo[110976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:03:59 devstack sudo[110976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:59 devstack sudo[110976]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.524s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:59 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img Aug 25 07:03:59 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:00 devstack sudo[111012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:04:00 devstack sudo[111012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:01 devstack sudo[111012]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.814s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:04:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:04:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:04:05 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img" returned: 0 in 6.023s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:05 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0a0ac-144e-44b8-b024-5552deaf632d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ea866f85-cb27-43f8-a934-70cd37460005 req-88f7a9ac-6a90-43d8-b0e9-2dbe7594e276 tempest-TestShelveInstance-1182219359 None] Terminate volume connection completed successfully. Aug 25 07:04:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ea866f85-cb27-43f8-a934-70cd37460005 req-88f7a9ac-6a90-43d8-b0e9-2dbe7594e276 tempest-TestShelveInstance-1182219359 None] Deleting attachment 11d0d80b-ce17-48f5-b927-bdd1c42fd533. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:04:05 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:04:05 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Acquiring lock "cinder-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "cinder-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Acquiring lock "cinder-quobyte-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "cinder-quobyte-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" acquired by "delete_volume" :: waited 0.038s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3014665-9092-4ff6-82b8-f3ae750cb4ee]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:06 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.945s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:04:06 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Converted 1024.00 MB image at 169.96 MB/s Aug 25 07:04:06 devstack sudo[111096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 Aug 25 07:04:06 devstack sudo[111096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] 4766ce3b-008b-40df-a0c1-7a940f79c03a was raw, converting to qcow2 {{(pid=94487) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5179d-4174-4a12-a8e1-701129eedcb5]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:06 devstack sudo[111105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img Aug 25 07:04:06 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:06 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img" returned: 0 in 0.429s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:06 devstack sudo[111096]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" returned: 0 in 0.749s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:06 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2 Aug 25 07:04:06 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack sudo[111121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img Aug 25 07:04:07 devstack sudo[111121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "cinder-quobyte-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2" released by "delete_volume" :: held 1.190s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.quota [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Created reservations ['fde7ad28-dc7a-42b7-ad65-abeb262d732c', '90f1e91b-e586-40eb-a0c6-7924b7e7bc91', '561ba8ed-08bd-4f2c-b6d7-44fc4115e027', '895361fb-01b9-4a1e-acd6-7c9ae31deb65'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:07 devstack sudo[111121]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img" returned: 1 in 0.554s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q Aug 25 07:04:07 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:04:07 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q" returned: 0 in 0.409s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Image conversion details: src /opt/stack/data/cinder/conversion/4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5.temp_image.4766ce3b-008b-40df-a0c1-7a940f79c03axh1qwola.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:04:07 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b0162-e016-4630-afd6-5c2e16dff813]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.292s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.manager [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Deleted volume successfully. Aug 25 07:04:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [req-ea866f85-cb27-43f8-a934-70cd37460005 req-545598fd-ab7f-4ff0-918d-3636f6fa923d tempest-TestShelveInstance-1182219359 None] Lock "cinder-2f2b8ac3-c137-4fd8-a833-6a7fe2a87cd2-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:08 devstack sudo[111153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q Aug 25 07:04:08 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:08 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a6nk1o3q" returned: 0 in 0.529s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.085s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:10 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Uploaded volume to glance image-id: 4766ce3b-008b-40df-a0c1-7a940f79c03a. {{(pid=94487) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 25 07:04:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d7389fe3-280a-4939-8a6e-5fae4830d390 tempest-VolumesActionsTest-1239135956 None] Copy volume to image completed successfully. Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "cinder-quobyte-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-quobyte-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[902959a0-f2dd-4e51-868d-08ebd2cf2e7a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:12 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:04:12 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:12 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.587s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:12 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5 Aug 25 07:04:12 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:13 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" returned: 0 in 0.380s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-quobyte-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5" released by "delete_volume" :: held 1.019s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Created reservations ['68f6c878-e704-443f-aeab-494a5bf6a40c', '2ec9f8af-0fbf-448e-ae46-51d3a2364beb', '54b0e650-28ac-434a-a7ef-3031f53a09a2', '7c13946b-b260-4d35-b023-bafdcf4cb8ca'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:13 devstack sudo[111175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:04:13 devstack sudo[111175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:13 devstack sudo[111175]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.280s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:13 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Deleted volume successfully. Aug 25 07:04:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4596bb26-c7dc-480c-a168-e014579be967 tempest-VolumesActionsTest-1239135956 None] Lock "cinder-4eb96c2e-b7eb-40e5-a8ed-b5426a0b9fe5-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:23 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:04:23 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=3 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Flow 'volume_create_manager' (95081a5e-a429-4aa2-a8e7-bdc3b702c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6aa879-54c7-467a-99e2-1a54d38a4757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6aa879-54c7-467a-99e2-1a54d38a4757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1812740997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576083a1-6675-473a-b217-2e1cac175528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e2ad9af0f401ca80e97bc9b16b183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:24Z,use_quota=True,user_id='a51de12ad266493984ad56e03e7fe6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ba730-cc9a-4a66-86a8-0242bb7104a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ba730-cc9a-4a66-86a8-0242bb7104a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a095a5-0b11-458d-8678-69c6401d494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a095a5-0b11-458d-8678-69c6401d494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576083a1-6675-473a-b217-2e1cac175528', 'volume_name': 'volume-576083a1-6675-473a-b217-2e1cac175528', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f5fd52-18e3-432e-b975-898b4a289b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f5fd52-18e3-432e-b975-898b4a289b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c743225c-cdf3-494b-bb18-8924117cac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:24 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Volume 576083a1-6675-473a-b217-2e1cac175528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576083a1-6675-473a-b217-2e1cac175528', 'volume_size': 1} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1812740997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576083a1-6675-473a-b217-2e1cac175528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e2ad9af0f401ca80e97bc9b16b183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:24Z,use_quota=True,user_id='a51de12ad266493984ad56e03e7fe6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Creating volume 576083a1-6675-473a-b217-2e1cac175528 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:24 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:04:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:24 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 1073741824 Aug 25 07:04:24 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 1073741824" returned: 0 in 0.446s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:25 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 Aug 25 07:04:25 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528" returned: 0 in 0.248s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c743225c-cdf3-494b-bb18-8924117cac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576083a1-6675-473a-b217-2e1cac175528', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c19313b-cdf5-40d5-a2e6-228657599fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Volume volume-576083a1-6675-473a-b217-2e1cac175528 (576083a1-6675-473a-b217-2e1cac175528): created successfully Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c19313b-cdf5-40d5-a2e6-228657599fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Flow 'volume_create_manager' (95081a5e-a429-4aa2-a8e7-bdc3b702c607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-28f8ce88-3a78-4cc9-8b83-b37ff6e36a5e tempest-VolumesNegativeTest-1646030142 None] Created volume successfully. Aug 25 07:04:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-f643787b-34ca-4d25-bfa0-afcdd46cf4f4 req-6f4d9f81-ed28-45cd-a268-2e60bcad5dd3 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-f643787b-34ca-4d25-bfa0-afcdd46cf4f4 req-6f4d9f81-ed28-45cd-a268-2e60bcad5dd3 tempest-TestStampPattern-1495504115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-f643787b-34ca-4d25-bfa0-afcdd46cf4f4 req-6f4d9f81-ed28-45cd-a268-2e60bcad5dd3 tempest-TestStampPattern-1495504115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-f643787b-34ca-4d25-bfa0-afcdd46cf4f4 req-6f4d9f81-ed28-45cd-a268-2e60bcad5dd3 tempest-TestStampPattern-1495504115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b4cb567-ada0-4170-ae53-4a782e4ee12b', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:04:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-f643787b-34ca-4d25-bfa0-afcdd46cf4f4 req-6f4d9f81-ed28-45cd-a268-2e60bcad5dd3 tempest-TestStampPattern-1495504115 None] attachment_update completed successfully. Aug 25 07:04:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-51c35748-8dc7-4ff8-9ba4-4376e99ed5e7 req-065213bd-df20-4548-b266-5b6bfdf049ed tempest-TestStampPattern-1495504115 None] Terminate volume connection completed successfully. Aug 25 07:04:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-51c35748-8dc7-4ff8-9ba4-4376e99ed5e7 req-065213bd-df20-4548-b266-5b6bfdf049ed tempest-TestStampPattern-1495504115 None] Deleting attachment 2b4cb567-ada0-4170-ae53-4a782e4ee12b. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Creating offline snapshot bfb7f710-90f3-461f-b725-4017793d5300 of volume 571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[577136b6-6548-4c03-a65f-9271cbc4fcdf]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:42 devstack sudo[111801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:04:42 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:42 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.461s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:42 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 1G Aug 25 07:04:42 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:43 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 1G" returned: 0 in 0.615s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:43 devstack sudo[111820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:04:43 devstack sudo[111820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:43 devstack sudo[111820]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.331s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:43 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 is being set with open permissions: ugo+rw Aug 25 07:04:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:43 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:04:43 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:44 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.276s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:44 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info Aug 25 07:04:44 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:44 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info" returned: 0 in 0.311s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:44 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info is being set with open permissions: ugo+rw Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:44 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info Aug 25 07:04:44 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:44 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.info" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3ed50f56-0d14-40a6-b789-a8222c33bd69 tempest-TestStampPattern-1495504115 None] Create snapshot completed successfully Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Acquiring lock "cinder-576083a1-6675-473a-b217-2e1cac175528-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "cinder-576083a1-6675-473a-b217-2e1cac175528-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Acquiring lock "cinder-quobyte-576083a1-6675-473a-b217-2e1cac175528" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "cinder-quobyte-576083a1-6675-473a-b217-2e1cac175528" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d069e-c34a-47ec-92a7-b0cece2971be]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:47 devstack sudo[111834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 Aug 25 07:04:47 devstack sudo[111834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:47 devstack sudo[111834]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528" returned: 0 in 0.493s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:47 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528 Aug 25 07:04:47 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:47 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-576083a1-6675-473a-b217-2e1cac175528" returned: 0 in 0.335s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "cinder-quobyte-576083a1-6675-473a-b217-2e1cac175528" released by "delete_volume" :: held 0.880s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Created reservations ['1aafb1d2-a716-43f3-bf51-7bb81edc235f', '84898e5a-a0b7-420a-92d4-8e7701001808', '0cca3b7b-ad98-49c3-9e25-e59efe60ecca', '19c1f632-2521-4227-97aa-55325f09458f'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:47 devstack sudo[111860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:04:47 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:48 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:48 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Deleted volume successfully. Aug 25 07:04:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3b006b43-c200-4c92-ae76-69ebcd3d1131 tempest-VolumesNegativeTest-1646030142 None] Lock "cinder-576083a1-6675-473a-b217-2e1cac175528-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Flow 'volume_create_manager' (8ff3b0c3-aa00-4ca5-b15d-95e14583dbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f4692-9742-4a7b-82f3-b069ad3cc299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f4692-9742-4a7b-82f3-b069ad3cc299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1370717367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270af291-2348-4e53-bf80-a2bfc6abd2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eac8f42a11f41d3b7bb7ec2bc70f306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:51Z,use_quota=True,user_id='7a954cd9277c4437a21ac7097cb5962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8597e5b-d386-4657-a5c9-c74d37b2d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8597e5b-d386-4657-a5c9-c74d37b2d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ddea2-7edd-4256-bc78-0ae58dcd6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ddea2-7edd-4256-bc78-0ae58dcd6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270af291-2348-4e53-bf80-a2bfc6abd2ec', 'volume_name': 'volume-270af291-2348-4e53-bf80-a2bfc6abd2ec', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b338dc05-7a10-44fe-a325-422cd13dad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b338dc05-7a10-44fe-a325-422cd13dad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a231c61-da89-4a91-908c-ff8769c0bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Volume 270af291-2348-4e53-bf80-a2bfc6abd2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270af291-2348-4e53-bf80-a2bfc6abd2ec', 'volume_size': 1} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1370717367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270af291-2348-4e53-bf80-a2bfc6abd2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eac8f42a11f41d3b7bb7ec2bc70f306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:51Z,use_quota=True,user_id='7a954cd9277c4437a21ac7097cb5962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Creating volume 270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:50 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:04:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:50 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec 1073741824 Aug 25 07:04:50 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:51 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec 1073741824" returned: 0 in 0.530s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:51 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:04:51 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:51 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.330s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a231c61-da89-4a91-908c-ff8769c0bb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270af291-2348-4e53-bf80-a2bfc6abd2ec', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fae84c-a54a-4cb8-9a81-eec5f03ac536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Volume volume-270af291-2348-4e53-bf80-a2bfc6abd2ec (270af291-2348-4e53-bf80-a2bfc6abd2ec): created successfully Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fae84c-a54a-4cb8-9a81-eec5f03ac536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Flow 'volume_create_manager' (8ff3b0c3-aa00-4ca5-b15d-95e14583dbe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2df586b0-30ff-4c64-bbac-5c5f277eb722 tempest-TestImageHashVerification-669221514 None] Created volume successfully. Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d6f5f-84f5-440e-aab3-76dc65d48f2a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Flow 'volume_create_manager' (18731f91-886d-43e1-b57e-7e54d15c2731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb24f3b-05af-4b43-ac37-cc09305add0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb24f3b-05af-4b43-ac37-cc09305add0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-649589153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7514c693-790a-49ee-8268-2dc85f10f884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3732314b1562435697f6fc768ed053ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bfb7f710-90f3-461f-b725-4017793d5300,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:54Z,use_quota=True,user_id='67d88bae146047cda2836886b81b91e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82bb114-42f5-4037-b11b-8923f74fd55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82bb114-42f5-4037-b11b-8923f74fd55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946fba80-1a4c-4834-a52a-1469e5afca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946fba80-1a4c-4834-a52a-1469e5afca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7514c693-790a-49ee-8268-2dc85f10f884', 'volume_name': 'volume-7514c693-790a-49ee-8268-2dc85f10f884', 'volume_size': 1, 'snapshot_id': 'bfb7f710-90f3-461f-b725-4017793d5300'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c26bda-3b82-4cbb-9010-e82a358a74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c26bda-3b82-4cbb-9010-e82a358a74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749bac6a-ea70-4462-9fa7-450c67289d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Volume 7514c693-790a-49ee-8268-2dc85f10f884: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7514c693-790a-49ee-8268-2dc85f10f884', 'volume_size': 1, 'snapshot_id': 'bfb7f710-90f3-461f-b725-4017793d5300'} Aug 25 07:04:54 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:04:54 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:54 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.435s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6745464-487d-43d7-a2d1-c8bb32b55d61]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:54 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:04:54 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:54 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.529s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec /opt/stack/data/cinder/conversion/270af291-2348-4e53-bf80-a2bfc6abd2ec.temp_image.c690d571-ffe2-45af-a8d1-2111443904e6uxothew2.img {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:54 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec /opt/stack/data/cinder/conversion/270af291-2348-4e53-bf80-a2bfc6abd2ec.temp_image.c690d571-ffe2-45af-a8d1-2111443904e6uxothew2.img Aug 25 07:04:54 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:00 devstack sudo[111961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:05:00 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:01 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec /opt/stack/data/cinder/conversion/270af291-2348-4e53-bf80-a2bfc6abd2ec.temp_image.c690d571-ffe2-45af-a8d1-2111443904e6uxothew2.img" returned: 0 in 6.178s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2476bc4c-d542-4c7c-abf7-4229819b2f2e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:01 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.502s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:01 devstack sudo[111963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:05:01 devstack sudo[111963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:05:01 devstack sudo[111963]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.852s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/270af291-2348-4e53-bf80-a2bfc6abd2ec.temp_image.c690d571-ffe2-45af-a8d1-2111443904e6uxothew2.img {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:05:01 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Converted 1024.00 MB image at 165.66 MB/s Aug 25 07:05:01 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] c690d571-ffe2-45af-a8d1-2111443904e6 was raw, no need to convert to raw {{(pid=94487) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 25 07:05:11 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:05:11 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:INSERT=3,cinder:DELETE=3 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.400s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Uploaded volume to glance image-id: c690d571-ffe2-45af-a8d1-2111443904e6. {{(pid=94487) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 36.226s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300-7514c693-790a-49ee-8268-2dc85f10f884" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300-7514c693-790a-49ee-8268-2dc85f10f884" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Creating volume 7514c693-790a-49ee-8268-2dc85f10f884 from snapshot bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5877bc82-73f0-4450-b924-2c7b6f6cdc7a tempest-TestImageHashVerification-669221514 None] Copy volume to image completed successfully. Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] snapshot: bfb7f710-90f3-461f-b725-4017793d5300, volume: 7514c693-790a-49ee-8268-2dc85f10f884, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb7d89-98da-46e5-822e-b8f3d68ebc46]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:30 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:05:30 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:30 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.412s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e0589-4c40-413a-bbf3-bf894c3bcfa9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:30 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:05:30 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:31 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.417s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:05:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:05:31 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:05:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:31 devstack sudo[112105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 Aug 25 07:05:31 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Acquiring lock "cinder-270af291-2348-4e53-bf80-a2bfc6abd2ec-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "cinder-270af291-2348-4e53-bf80-a2bfc6abd2ec-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Acquiring lock "cinder-quobyte-270af291-2348-4e53-bf80-a2bfc6abd2ec" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "cinder-quobyte-270af291-2348-4e53-bf80-a2bfc6abd2ec" acquired by "delete_volume" :: waited 0.064s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f05a01-85b1-43a0-9b62-e0a0bb800eb1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:32 devstack sudo[112167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:05:32 devstack sudo[112167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:33 devstack sudo[112167]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.853s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:33 devstack sudo[112187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec Aug 25 07:05:33 devstack sudo[112187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:34 devstack sudo[112187]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-270af291-2348-4e53-bf80-a2bfc6abd2ec" returned: 0 in 0.770s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "cinder-quobyte-270af291-2348-4e53-bf80-a2bfc6abd2ec" released by "delete_volume" :: held 1.761s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Created reservations ['61c821af-8edd-4335-a82e-fb960d24c0a6', 'b5a382e1-1954-4892-bc67-08bf00e04381', '32ba0dbf-8bbd-452a-a09d-e2fdf937a25b', '55a7353b-844d-4259-a650-303211e05179'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:34 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:05:34 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:35 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.967s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:35 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Deleted volume successfully. Aug 25 07:05:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-477ca016-d9ca-4fa2-9ac8-ba62784d4428 tempest-TestImageHashVerification-669221514 None] Lock "cinder-270af291-2348-4e53-bf80-a2bfc6abd2ec-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:39 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884" returned: 0 in 8.470s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:39 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:05:39 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Converted 1024.00 MB image at 120.88 MB/s Aug 25 07:05:39 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 is being set with open permissions: ugo+rw Aug 25 07:05:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:39 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 Aug 25 07:05:39 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:40 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" released by "_copy_volume_from_snapshot" :: held 9.741s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300-7514c693-790a-49ee-8268-2dc85f10f884" released by "_create_volume_from_snapshot" :: held 9.875s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.908s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749bac6a-ea70-4462-9fa7-450c67289d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7514c693-790a-49ee-8268-2dc85f10f884', 'volume_size': 1, 'snapshot_id': 'bfb7f710-90f3-461f-b725-4017793d5300'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e3ff3-7619-4144-892b-46dcc4dd502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:40 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Volume volume-7514c693-790a-49ee-8268-2dc85f10f884 (7514c693-790a-49ee-8268-2dc85f10f884): created successfully Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e3ff3-7619-4144-892b-46dcc4dd502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Flow 'volume_create_manager' (18731f91-886d-43e1-b57e-7e54d15c2731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:05:40 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b78ee550-1489-4612-ba95-c868830c05c5 tempest-TestStampPattern-1495504115 None] Created volume successfully. Aug 25 07:05:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-57e59ddc-d1dd-407b-b0c8-ad7daf72b6b8 req-2980e9bd-1c95-43ea-a5c9-0c1cd90d9a6e tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-57e59ddc-d1dd-407b-b0c8-ad7daf72b6b8 req-2980e9bd-1c95-43ea-a5c9-0c1cd90d9a6e tempest-TestStampPattern-1495504115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-57e59ddc-d1dd-407b-b0c8-ad7daf72b6b8 req-2980e9bd-1c95-43ea-a5c9-0c1cd90d9a6e tempest-TestStampPattern-1495504115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-57e59ddc-d1dd-407b-b0c8-ad7daf72b6b8 req-2980e9bd-1c95-43ea-a5c9-0c1cd90d9a6e tempest-TestStampPattern-1495504115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-7514c693-790a-49ee-8268-2dc85f10f884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c155ebb4-b05f-4a31-a7d5-b5c8169f0707', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:05:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-57e59ddc-d1dd-407b-b0c8-ad7daf72b6b8 req-2980e9bd-1c95-43ea-a5c9-0c1cd90d9a6e tempest-TestStampPattern-1495504115 None] attachment_update completed successfully. Aug 25 07:05:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-525d394d-7608-4899-b629-9dd239517096 req-3bb5b3ea-d1ff-496c-95c1-da1e5d9eaaf7 tempest-TestStampPattern-1495504115 None] Terminate volume connection completed successfully. Aug 25 07:05:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-525d394d-7608-4899-b629-9dd239517096 req-3bb5b3ea-d1ff-496c-95c1-da1e5d9eaaf7 tempest-TestStampPattern-1495504115 None] Deleting attachment c155ebb4-b05f-4a31-a7d5-b5c8169f0707. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-7514c693-790a-49ee-8268-2dc85f10f884-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "cinder-7514c693-790a-49ee-8268-2dc85f10f884-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[60029891-aa87-4457-b761-4265b0ba5cb0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:50 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 Aug 25 07:05:50 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:51 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:51 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884 Aug 25 07:05:51 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:51 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7514c693-790a-49ee-8268-2dc85f10f884" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-7514c693-790a-49ee-8268-2dc85f10f884" released by "delete_volume" :: held 0.702s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Created reservations ['405f7dfb-3d1b-4a0b-a536-54353282a540', '23331223-7d93-4977-b32d-9e9ea0b8aca3', '12854dd3-580d-4dc7-bca6-1382d3603bd7', 'f7852b1d-e092-41e8-bdbc-d632d08600a2'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:51 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:05:51 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:51 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Deleted volume successfully. Aug 25 07:05:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f93322f2-af16-4fb8-8dfd-3f30292d5d41 tempest-TestStampPattern-1495504115 None] Lock "cinder-7514c693-790a-49ee-8268-2dc85f10f884-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-bfb7f710-90f3-461f-b725-4017793d5300-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-bfb7f710-90f3-461f-b725-4017793d5300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Deleting offline snapshot bfb7f710-90f3-461f-b725-4017793d5300 of volume 571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] snapshot_file for this snap is: volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e624d552-0256-4025-9627-91dfc428cd31]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:52 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:05:52 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:52 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.389s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6c4c7-fc4a-4e9c-8950-8ffbc6cdbc1b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:52 devstack sudo[112771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:05:52 devstack sudo[112771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:53 devstack sudo[112771]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.559s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:53 devstack sudo[112776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:05:53 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:53 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:53 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300 Aug 25 07:05:53 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:53 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c.bfb7f710-90f3-461f-b725-4017793d5300" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-bfb7f710-90f3-461f-b725-4017793d5300" released by "_delete_snapshot" :: held 1.688s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" released by "delete_snapshot" :: held 1.718s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:53 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Created reservations ['6f355692-2a3b-473b-aaff-d5a76d933dc9', '03989006-a7bf-403b-9699-9f0e4dc135e9', 'c1f3c510-549a-4288-9036-b11812ac9595', '995f16f2-3ca0-4aa6-acc3-348895a06ea0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Delete snapshot completed successfully. Aug 25 07:05:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-62c86380-bdff-4e29-9a38-288d54649834 tempest-TestStampPattern-1495504115 None] Lock "cinder-bfb7f710-90f3-461f-b725-4017793d5300-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-571ea2c9-3860-4043-ad90-e1a27de6fc9c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "cinder-571ea2c9-3860-4043-ad90-e1a27de6fc9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Acquiring lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" acquired by "delete_volume" :: waited 0.013s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316ba6f-92ea-4864-a72b-69f1957406f2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:58 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:05:58 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:59 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.360s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:59 devstack sudo[112862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c Aug 25 07:05:59 devstack sudo[112862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:59 devstack sudo[112862]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-571ea2c9-3860-4043-ad90-e1a27de6fc9c" returned: 0 in 0.244s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "cinder-quobyte-571ea2c9-3860-4043-ad90-e1a27de6fc9c" released by "delete_volume" :: held 0.662s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Created reservations ['9e2584da-64e7-4bd0-b2a7-dc2faabd998a', 'f7ee21f1-0fb2-4c01-bca2-1372bb3aa4ce', 'bc200250-3df4-4439-aa2d-1caa9bf6d33d', 'd85f4980-e899-4e5b-86bd-031e8e8115c1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:59 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:05:59 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:59 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Deleted volume successfully. Aug 25 07:05:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e37a856-ea03-4b86-ba3f-73616ee77367 tempest-TestStampPattern-1495504115 None] Lock "cinder-571ea2c9-3860-4043-ad90-e1a27de6fc9c-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:00 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:00 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:01 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:06:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:06:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Flow 'volume_create_manager' (3ef4ea82-14a9-4ed2-90f3-12a4da52abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d4f3ab-a8da-4814-95a9-0a604127f318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d4f3ab-a8da-4814-95a9-0a604127f318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-444414133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a393ed8b-36ca-49de-a071-fb2291fe8370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51624fe1839a444a842d4fb43c07d568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:02Z,use_quota=True,user_id='cd661adf7bf64ce0aa42e4264cba2ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46b62b-92cf-4cb1-a5c2-fa364ae4ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46b62b-92cf-4cb1-a5c2-fa364ae4ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6178c8ec-4cbf-4f57-a928-f73d2c4d6a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6178c8ec-4cbf-4f57-a928-f73d2c4d6a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a393ed8b-36ca-49de-a071-fb2291fe8370', 'volume_name': 'volume-a393ed8b-36ca-49de-a071-fb2291fe8370', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3ab8dc-3505-4802-a438-ca3fa1a82b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3ab8dc-3505-4802-a438-ca3fa1a82b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d06f69-ab05-491a-a5e0-91e047d77bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Volume a393ed8b-36ca-49de-a071-fb2291fe8370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a393ed8b-36ca-49de-a071-fb2291fe8370', 'volume_size': 1} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-444414133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a393ed8b-36ca-49de-a071-fb2291fe8370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51624fe1839a444a842d4fb43c07d568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:02Z,use_quota=True,user_id='cd661adf7bf64ce0aa42e4264cba2ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Creating volume a393ed8b-36ca-49de-a071-fb2291fe8370 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:02 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:02 devstack sudo[112873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 1073741824 Aug 25 07:06:02 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:02 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 1073741824" returned: 0 in 0.461s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:02 devstack sudo[112880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 Aug 25 07:06:02 devstack sudo[112880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:02 devstack sudo[112880]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d06f69-ab05-491a-a5e0-91e047d77bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a393ed8b-36ca-49de-a071-fb2291fe8370', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fc07c4-f952-44bd-a8c7-4116e4a67423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Volume volume-a393ed8b-36ca-49de-a071-fb2291fe8370 (a393ed8b-36ca-49de-a071-fb2291fe8370): created successfully Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fc07c4-f952-44bd-a8c7-4116e4a67423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Flow 'volume_create_manager' (3ef4ea82-14a9-4ed2-90f3-12a4da52abe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-89b24f6c-124f-457a-a3d5-8488070e8907 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Created volume successfully. Aug 25 07:06:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3cf380f0-d878-4ca0-97b6-89ed861446a4 req-2d046fc6-2550-444a-8d7c-57a5c8486158 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3cf380f0-d878-4ca0-97b6-89ed861446a4 req-2d046fc6-2550-444a-8d7c-57a5c8486158 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [req-3cf380f0-d878-4ca0-97b6-89ed861446a4 req-2d046fc6-2550-444a-8d7c-57a5c8486158 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-3cf380f0-d878-4ca0-97b6-89ed861446a4 req-2d046fc6-2550-444a-8d7c-57a5c8486158 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07', 'name': 'volume-a393ed8b-36ca-49de-a071-fb2291fe8370', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1473b1b-3b2e-4772-ba6d-52f52d785f2c', 'enforce_multipath': True} {{(pid=94487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Aug 25 07:06:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-3cf380f0-d878-4ca0-97b6-89ed861446a4 req-2d046fc6-2550-444a-8d7c-57a5c8486158 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] attachment_update completed successfully. Aug 25 07:06:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [req-ef5c3944-2fde-470d-9b22-9bfa0a0ddc6e req-33fdad3c-34c7-4ee4-bd6f-4831d0bf9462 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Terminate volume connection completed successfully. Aug 25 07:06:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [req-ef5c3944-2fde-470d-9b22-9bfa0a0ddc6e req-33fdad3c-34c7-4ee4-bd6f-4831d0bf9462 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Deleting attachment d1473b1b-3b2e-4772-ba6d-52f52d785f2c. {{(pid=94487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "cinder-a393ed8b-36ca-49de-a071-fb2291fe8370-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "cinder-a393ed8b-36ca-49de-a071-fb2291fe8370-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "cinder-quobyte-a393ed8b-36ca-49de-a071-fb2291fe8370" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "cinder-quobyte-a393ed8b-36ca-49de-a071-fb2291fe8370" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c542a0-a3ad-4ad1-8c66-5ddff0404c61]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:09 devstack sudo[113312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 Aug 25 07:06:09 devstack sudo[113312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:09 devstack sudo[113312]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370" returned: 0 in 0.419s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:09 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370 Aug 25 07:06:09 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:10 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a393ed8b-36ca-49de-a071-fb2291fe8370" returned: 0 in 0.258s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "cinder-quobyte-a393ed8b-36ca-49de-a071-fb2291fe8370" released by "delete_volume" :: held 0.723s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Created reservations ['2fd7368f-ab5d-4a1c-a90a-216e418475d3', '542f5427-8b80-457d-b515-2643f77b3721', '02b9f1e0-dee2-46f2-8e3c-29187e3cc0ea', '5832d37a-6c09-49bd-b127-160bf1315b9d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:10 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:10 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:10 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Deleted volume successfully. Aug 25 07:06:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80759e0f-2bd4-4d77-b0cc-77c70f437346 tempest-TestServerVolumeAttachScenarioOldVersion-1947489499 None] Lock "cinder-a393ed8b-36ca-49de-a071-fb2291fe8370-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Flow 'volume_create_manager' (18750f9c-6f40-4df9-be75-26d65a512039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c947f7-3965-4a98-9a67-151edd9d8688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c947f7-3965-4a98-9a67-151edd9d8688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d761cb-1a2c-4d3d-8c91-c4dab6156659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27af611cd3f46c3b44fc574b49bd0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:14Z,use_quota=True,user_id='37bf98fe8bfc441aa45e922205877f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a44e70-f3fd-41dc-9965-74a49fd714d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a44e70-f3fd-41dc-9965-74a49fd714d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db718224-6b75-4c7b-afe8-68d0311cb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db718224-6b75-4c7b-afe8-68d0311cb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d761cb-1a2c-4d3d-8c91-c4dab6156659', 'volume_name': 'volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b31d447-6872-4a38-bcf8-3c27606e0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b31d447-6872-4a38-bcf8-3c27606e0e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5dff76-0a21-4906-9b71-8e787a99609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Volume 53d761cb-1a2c-4d3d-8c91-c4dab6156659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659', 'volume_size': 1} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d761cb-1a2c-4d3d-8c91-c4dab6156659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27af611cd3f46c3b44fc574b49bd0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:14Z,use_quota=True,user_id='37bf98fe8bfc441aa45e922205877f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Creating volume 53d761cb-1a2c-4d3d-8c91-c4dab6156659 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:13 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:13 devstack sudo[113350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 1073741824 Aug 25 07:06:13 devstack sudo[113350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:14 devstack sudo[113350]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 1073741824" returned: 0 in 0.462s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:14 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 Aug 25 07:06:14 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:14 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5dff76-0a21-4906-9b71-8e787a99609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a497e8d1-f3f2-4de4-8a65-71fb0696cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Volume volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 (53d761cb-1a2c-4d3d-8c91-c4dab6156659): created successfully Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a497e8d1-f3f2-4de4-8a65-71fb0696cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Flow 'volume_create_manager' (18750f9c-6f40-4df9-be75-26d65a512039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b1926d06-d6dc-496f-b407-400a6a56bfb2 tempest-CinderUnicodeTest-1752767159 None] Created volume successfully. Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Flow 'volume_create_manager' (d7057f71-70ca-4e60-adc8-8a20975c6f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fe5ca9-499b-4e89-a6c0-ffe5257a4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fe5ca9-499b-4e89-a6c0-ffe5257a4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-660998495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a69cac-517e-4c5d-9b41-2117fb5a72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27af611cd3f46c3b44fc574b49bd0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:16Z,use_quota=True,user_id='37bf98fe8bfc441aa45e922205877f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701643e-c7ce-4374-9eeb-04c45ef1fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701643e-c7ce-4374-9eeb-04c45ef1fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d162c4-6fc1-4dcb-b610-e7d7b1af03d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d162c4-6fc1-4dcb-b610-e7d7b1af03d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a69cac-517e-4c5d-9b41-2117fb5a72bd', 'volume_name': 'volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ead2e2-30ad-41a5-84df-a0c49be01153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ead2e2-30ad-41a5-84df-a0c49be01153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f7375e-c513-4bae-a72a-99c0835a3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:16 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Volume 79a69cac-517e-4c5d-9b41-2117fb5a72bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd', 'volume_size': 1} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-660998495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a69cac-517e-4c5d-9b41-2117fb5a72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27af611cd3f46c3b44fc574b49bd0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:16Z,use_quota=True,user_id='37bf98fe8bfc441aa45e922205877f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Creating volume 79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:16 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:16 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd 1073741824 Aug 25 07:06:16 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:17 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd 1073741824" returned: 0 in 0.434s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:17 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd Aug 25 07:06:17 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:17 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f7375e-c513-4bae-a72a-99c0835a3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76b8357-0b37-4bef-b281-62fb59c8d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Volume volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd (79a69cac-517e-4c5d-9b41-2117fb5a72bd): created successfully Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76b8357-0b37-4bef-b281-62fb59c8d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Flow 'volume_create_manager' (d7057f71-70ca-4e60-adc8-8a20975c6f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9b4ebd7c-45c4-4a2a-9b31-bc9970332770 tempest-CinderUnicodeTest-1752767159 None] Created volume successfully. Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Creating offline snapshot 34a255b4-5060-4076-b242-ec62e4d6ff65 of volume 79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21a713-a7f3-47d8-aa8f-f4c1467492b4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:17 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd Aug 25 07:06:17 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:18 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:18 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 1G Aug 25 07:06:18 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:18 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 1G" returned: 0 in 0.451s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:18 devstack sudo[113384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 Aug 25 07:06:18 devstack sudo[113384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:19 devstack sudo[113384]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65" returned: 0 in 0.315s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:19 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 is being set with open permissions: ugo+rw Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:19 devstack sudo[113390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 Aug 25 07:06:19 devstack sudo[113390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:19 devstack sudo[113390]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65" returned: 0 in 0.247s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:19 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info Aug 25 07:06:19 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:19 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:19 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info is being set with open permissions: ugo+rw Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:19 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info Aug 25 07:06:19 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:19 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.info" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-801e5f74-75e1-4323-8b58-6d50ec1e2899 tempest-CinderUnicodeTest-1752767159 None] Create snapshot completed successfully Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-34a255b4-5060-4076-b242-ec62e4d6ff65-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-34a255b4-5060-4076-b242-ec62e4d6ff65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-quobyte-34a255b4-5060-4076-b242-ec62e4d6ff65" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-34a255b4-5060-4076-b242-ec62e4d6ff65" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Deleting offline snapshot 34a255b4-5060-4076-b242-ec62e4d6ff65 of volume 79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] snapshot_file for this snap is: volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604c3c8-da87-45e7-bc43-7fb7be7ebb65]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:21 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 Aug 25 07:06:21 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:21 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65" returned: 0 in 0.414s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e79d99d-6258-4ddf-922c-75f17db8d62d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:21 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd Aug 25 07:06:21 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:21 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd" returned: 0 in 0.357s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:21 devstack sudo[113410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 Aug 25 07:06:21 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:22 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65" returned: 0 in 0.374s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:22 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65 Aug 25 07:06:22 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:22 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd.34a255b4-5060-4076-b242-ec62e4d6ff65" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=52,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=2 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-34a255b4-5060-4076-b242-ec62e4d6ff65" released by "_delete_snapshot" :: held 1.563s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" released by "delete_snapshot" :: held 1.587s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Created reservations ['0719bce8-513c-4d7b-a965-4f3b94248fde', 'e5c7cd48-af8d-4b75-a301-8fd9e038d38f', 'd4a43d36-30e4-4678-89e1-7187a36a6f88', '41719090-9e4b-4fee-835c-8e89f7f2a7af'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Delete snapshot completed successfully. Aug 25 07:06:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-54558623-f88b-4df5-81a5-60e044ccc35c tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-34a255b4-5060-4076-b242-ec62e4d6ff65-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-79a69cac-517e-4c5d-9b41-2117fb5a72bd-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-79a69cac-517e-4c5d-9b41-2117fb5a72bd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[94443bda-a7af-4973-85f2-0c61813b0a51]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:23 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd Aug 25 07:06:23 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:23 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd" returned: 0 in 0.386s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:23 devstack sudo[113425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd Aug 25 07:06:23 devstack sudo[113425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[113425]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79a69cac-517e-4c5d-9b41-2117fb5a72bd" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-79a69cac-517e-4c5d-9b41-2117fb5a72bd" released by "delete_volume" :: held 0.723s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Created reservations ['46969249-8542-40a2-bbca-2ec2dd18f308', '8ebc93a8-53a9-4d30-9158-03499dd6e988', '134c7c23-37aa-4bcc-b210-611c2c3b0b3b', '09750ddf-da4b-469e-9a2f-cd00dc00df89'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[113428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:24 devstack sudo[113428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[113428]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-53d761cb-1a2c-4d3d-8c91-c4dab6156659-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Deleted volume successfully. Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-53d761cb-1a2c-4d3d-8c91-c4dab6156659-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-99a0e46e-0d8d-4f30-bf5b-8996d3003339 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-79a69cac-517e-4c5d-9b41-2117fb5a72bd-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "cinder-quobyte-53d761cb-1a2c-4d3d-8c91-c4dab6156659" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-53d761cb-1a2c-4d3d-8c91-c4dab6156659" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfde7a3d-a8ae-4729-b6bb-11265bb48e3f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 Aug 25 07:06:24 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659" returned: 0 in 0.385s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659 Aug 25 07:06:24 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:25 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-53d761cb-1a2c-4d3d-8c91-c4dab6156659" returned: 0 in 0.262s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-quobyte-53d761cb-1a2c-4d3d-8c91-c4dab6156659" released by "delete_volume" :: held 0.689s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Created reservations ['81b6faa3-4d0d-49e4-9cd6-fdcd0ec8e90e', 'a4ac70c8-93da-4476-a5c5-d4434dcc5c07', 'a98169fa-1e21-4220-a691-c762404e45ba', 'f7e50bd8-7ca4-448a-9f7e-c619ba6be675'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:25 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:25 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:25 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Deleted volume successfully. Aug 25 07:06:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-92717843-3f63-4f26-aa77-3ddec50c6fc8 tempest-CinderUnicodeTest-1752767159 None] Lock "cinder-53d761cb-1a2c-4d3d-8c91-c4dab6156659-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Flow 'volume_create_manager' (3fb6e079-a312-451b-b4ec-47689668da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569127fa-06d3-4466-866e-081c54f26172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569127fa-06d3-4466-866e-081c54f26172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686490114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83862da7-d0ed-4ab7-ab52-5a2cedcae22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056e8873b8af4eecb4159b531f81f801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:29Z,use_quota=True,user_id='db7f0e1d9c264f2dbb6c63bcd128ed4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb2ae8-8f76-4d87-a3d1-2e98bfa6cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb2ae8-8f76-4d87-a3d1-2e98bfa6cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde4558a-08e4-4437-9b45-0323356fc077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde4558a-08e4-4437-9b45-0323356fc077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83862da7-d0ed-4ab7-ab52-5a2cedcae22f', 'volume_name': 'volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f330c52-8f7e-4635-a4ee-bb1578aedfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f330c52-8f7e-4635-a4ee-bb1578aedfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bc8a0b-b69a-4b58-a521-fe14cae793f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:29 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Volume 83862da7-d0ed-4ab7-ab52-5a2cedcae22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f', 'volume_size': 1} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686490114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83862da7-d0ed-4ab7-ab52-5a2cedcae22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056e8873b8af4eecb4159b531f81f801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:29Z,use_quota=True,user_id='db7f0e1d9c264f2dbb6c63bcd128ed4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Creating volume 83862da7-d0ed-4ab7-ab52-5a2cedcae22f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:29 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:29 devstack sudo[113446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f 1073741824 Aug 25 07:06:29 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:29 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f 1073741824" returned: 0 in 0.487s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:29 devstack sudo[113452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f Aug 25 07:06:29 devstack sudo[113452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:30 devstack sudo[113452]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" returned: 0 in 0.250s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bc8a0b-b69a-4b58-a521-fe14cae793f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b78c95-dff9-4044-9e15-85b7c6203c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Volume volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f (83862da7-d0ed-4ab7-ab52-5a2cedcae22f): created successfully Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b78c95-dff9-4044-9e15-85b7c6203c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Flow 'volume_create_manager' (3fb6e079-a312-451b-b4ec-47689668da88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-afb62c4d-920e-4ec1-9cc9-059cf1fdcb2b tempest-ProjectReaderTests-612238839 None] Created volume successfully. Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Flow 'volume_create_manager' (085a548c-91f9-49ba-8c9a-eefc4291609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd13bd1-e078-4cf1-a68d-df242ba2c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd13bd1-e078-4cf1-a68d-df242ba2c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be35a27-5631-45db-a61d-34673ee587fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1fb91365254664840d51f2120db885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:30Z,use_quota=True,user_id='fc9f7f2ce5dd48709858296b15ef8d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e790298c-c657-4210-90bd-e6773cb400e5),volume_type_id=e790298c-c657-4210-90bd-e6773cb400e5)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac84f07-4e85-498e-b24e-08854d1a083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac84f07-4e85-498e-b24e-08854d1a083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7e8f4b-431c-4fa1-ba41-5e967bc17109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7e8f4b-431c-4fa1-ba41-5e967bc17109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7be35a27-5631-45db-a61d-34673ee587fc', 'volume_name': 'volume-7be35a27-5631-45db-a61d-34673ee587fc', 'volume_size': 1, 'image_id': 'aae11088-3dce-4127-9908-e58027988dc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d1d6101dc95b94c1f494fc9274fc4a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1fb91365254664840d51f2120db885', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6134379f2f76b3b4e080c635652294ddd9669aa592c14e2af999f7e2cb91c9590c877acdfe0afd27ad39c63728ee4dcd75c1d12f99ecb0dc98b17cb5480d7344', 'id': 'aae11088-3dce-4127-9908-e58027988dc4', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aae11088-3dce-4127-9908-e58027988dc4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4803ce78-29e1-41b3-92be-183de36560ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4803ce78-29e1-41b3-92be-183de36560ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c7a289-b193-42d1-9012-1f2b20083842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:30 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Volume 7be35a27-5631-45db-a61d-34673ee587fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7be35a27-5631-45db-a61d-34673ee587fc', 'volume_size': 1, 'image_id': 'aae11088-3dce-4127-9908-e58027988dc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d1d6101dc95b94c1f494fc9274fc4a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1fb91365254664840d51f2120db885', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6134379f2f76b3b4e080c635652294ddd9669aa592c14e2af999f7e2cb91c9590c877acdfe0afd27ad39c63728ee4dcd75c1d12f99ecb0dc98b17cb5480d7344', 'id': 'aae11088-3dce-4127-9908-e58027988dc4', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aae11088-3dce-4127-9908-e58027988dc4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Trying to clone 7be35a27-5631-45db-a61d-34673ee587fc from image aae11088-3dce-4127-9908-e58027988dc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:06:30 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b633d5-a455-4bee-af40-fb504c66dd1e]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:30 devstack sudo[113455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:30 devstack sudo[113455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:31 devstack sudo[113455]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:31 devstack sudo[113459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:31 devstack sudo[113459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:31 devstack sudo[113459]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Acquiring lock "cinder-83862da7-d0ed-4ab7-ab52-5a2cedcae22f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Temporary image aae11088-3dce-4127-9908-e58027988dc4 is fetched for user fc9f7f2ce5dd48709858296b15ef8d40. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "cinder-83862da7-d0ed-4ab7-ab52-5a2cedcae22f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Acquiring lock "cinder-quobyte-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "cinder-quobyte-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d3ac27-cdbe-4968-b09f-a758e0937497]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ddefb-9ad7-4bbe-8931-a00211680a5b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:31 devstack sudo[113465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:31 devstack sudo[113465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:31 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f Aug 25 07:06:31 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:31 devstack sudo[113465]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:31 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" returned: 0 in 0.380s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack sudo[113475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f Aug 25 07:06:32 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:32 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" returned: 0 in 0.267s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be35a27-5631-45db-a61d-34673ee587fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1fb91365254664840d51f2120db885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:30Z,use_quota=True,user_id='fc9f7f2ce5dd48709858296b15ef8d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e790298c-c657-4210-90bd-e6773cb400e5),volume_type_id=e790298c-c657-4210-90bd-e6773cb400e5)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Creating volume 7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:32 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "cinder-quobyte-83862da7-d0ed-4ab7-ab52-5a2cedcae22f" released by "delete_volume" :: held 0.713s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:32 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1073741824 Aug 25 07:06:32 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=73,cinder:INSERT=18,cinder:UPDATE=80,cinder:DELETE=8 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Created reservations ['8cb5dca9-044e-4868-8683-0d560b21f935', 'a5c846d0-626f-4979-8487-264381b21b9a', '4d1ad146-5196-48eb-ba3b-8cf5c8f7ea5d', '324c8d09-8ce1-42a1-afe4-23defefc271b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack sudo[113484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:32 devstack sudo[113484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[113484]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Deleted volume successfully. Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4accf5da-5c68-4c05-96ce-9d8205de4cec tempest-ProjectReaderTests-612238839 None] Lock "cinder-83862da7-d0ed-4ab7-ab52-5a2cedcae22f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:32 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1073741824" returned: 0 in 0.458s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack sudo[113491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc Aug 25 07:06:32 devstack sudo[113491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113491]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc" returned: 0 in 0.286s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Attempting download of aae11088-3dce-4127-9908-e58027988dc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}])) to volume 7be35a27-5631-45db-a61d-34673ee587fc. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb1343-127a-4715-b701-674856c4384a]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Flow 'volume_create_manager' (de1551ab-0188-4de2-8296-ca2da2809656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db5bd5a-de34-443a-a5f4-f8b06c5b0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db5bd5a-de34-443a-a5f4-f8b06c5b0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559938702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a97b32c-e802-4ea4-9345-731b5278a950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056e8873b8af4eecb4159b531f81f801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:33Z,use_quota=True,user_id='db7f0e1d9c264f2dbb6c63bcd128ed4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eb2f13-a688-4c7c-b963-3eab58c9d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eb2f13-a688-4c7c-b963-3eab58c9d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64511f93-170a-4841-9874-235e1ecfef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64511f93-170a-4841-9874-235e1ecfef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a97b32c-e802-4ea4-9345-731b5278a950', 'volume_name': 'volume-5a97b32c-e802-4ea4-9345-731b5278a950', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b29898-ad94-47bf-97ce-f7c674bd4355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b29898-ad94-47bf-97ce-f7c674bd4355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8ddff8-2b43-4e4a-a9b4-18b11d5867e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Volume 5a97b32c-e802-4ea4-9345-731b5278a950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a97b32c-e802-4ea4-9345-731b5278a950', 'volume_size': 1} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559938702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a97b32c-e802-4ea4-9345-731b5278a950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056e8873b8af4eecb4159b531f81f801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:33Z,use_quota=True,user_id='db7f0e1d9c264f2dbb6c63bcd128ed4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Creating volume 5a97b32c-e802-4ea4-9345-731b5278a950 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:33 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:33 devstack sudo[113494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack sudo[113494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 1073741824 Aug 25 07:06:33 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113494]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g Aug 25 07:06:33 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 1073741824" returned: 0 in 0.441s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 Aug 25 07:06:33 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g" returned: 1 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aae11088-3dce-4127-9908-e58027988dc4_t0imo75g' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16761fb-bacc-4826-a4f5-ec96c995ec72]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:33 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950" returned: 0 in 0.261s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8ddff8-2b43-4e4a-a9b4-18b11d5867e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a97b32c-e802-4ea4-9345-731b5278a950', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c594b59-659c-4671-a496-f158a2535b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Volume volume-5a97b32c-e802-4ea4-9345-731b5278a950 (5a97b32c-e802-4ea4-9345-731b5278a950): created successfully Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c594b59-659c-4671-a496-f158a2535b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Flow 'volume_create_manager' (de1551ab-0188-4de2-8296-ca2da2809656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cebb7239-da0e-4f82-a4b7-4e936b8a0642 tempest-ProjectReaderTests-612238839 None] Created volume successfully. Aug 25 07:06:34 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:34 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD Aug 25 07:06:34 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:34 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] aae11088-3dce-4127-9908-e58027988dc4 was raw, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:34 devstack sudo[113520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc Aug 25 07:06:34 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:34 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc" returned: 0 in 0.452s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aae11088-3dce-4127-9908-e58027988dc4_pkngkej8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:06:34 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:06:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:34 devstack sudo[113525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1G Aug 25 07:06:34 devstack sudo[113525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Acquiring lock "cinder-5a97b32c-e802-4ea4-9345-731b5278a950-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "cinder-5a97b32c-e802-4ea4-9345-731b5278a950-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:35 devstack sudo[113525]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc 1G" returned: 0 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Downloaded image aae11088-3dce-4127-9908-e58027988dc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}])) to volume 7be35a27-5631-45db-a61d-34673ee587fc successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Temporary image aae11088-3dce-4127-9908-e58027988dc4 for user fc9f7f2ce5dd48709858296b15ef8d40 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Marking volume 7be35a27-5631-45db-a61d-34673ee587fc as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Copying metadata from image aae11088-3dce-4127-9908-e58027988dc4 to 7be35a27-5631-45db-a61d-34673ee587fc. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Creating volume glance metadata for volume 7be35a27-5631-45db-a61d-34673ee587fc backed by image aae11088-3dce-4127-9908-e58027988dc4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aae11088-3dce-4127-9908-e58027988dc4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7d1d6101dc95b94c1f494fc9274fc4a6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Acquiring lock "cinder-quobyte-5a97b32c-e802-4ea4-9345-731b5278a950" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "cinder-quobyte-5a97b32c-e802-4ea4-9345-731b5278a950" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[18888001-f5db-4b4e-9396-661c12e411db]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c7a289-b193-42d1-9012-1f2b20083842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be35a27-5631-45db-a61d-34673ee587fc', 'volume_size': 1, 'image_id': 'aae11088-3dce-4127-9908-e58027988dc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aae11088-3dce-4127-9908-e58027988dc4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d1d6101dc95b94c1f494fc9274fc4a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1fb91365254664840d51f2120db885', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6134379f2f76b3b4e080c635652294ddd9669aa592c14e2af999f7e2cb91c9590c877acdfe0afd27ad39c63728ee4dcd75c1d12f99ecb0dc98b17cb5480d7344', 'id': 'aae11088-3dce-4127-9908-e58027988dc4', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aae11088-3dce-4127-9908-e58027988dc4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d4bfa-0086-4831-afa4-fed4743b9734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Volume volume-7be35a27-5631-45db-a61d-34673ee587fc (7be35a27-5631-45db-a61d-34673ee587fc): created successfully Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d4bfa-0086-4831-afa4-fed4743b9734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Flow 'volume_create_manager' (085a548c-91f9-49ba-8c9a-eefc4291609b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8d0a1808-b923-4d5c-85ae-48d595cf5a7a tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Created volume successfully. Aug 25 07:06:35 devstack sudo[113530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 Aug 25 07:06:35 devstack sudo[113530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Acquiring lock "cinder-7be35a27-5631-45db-a61d-34673ee587fc-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "cinder-7be35a27-5631-45db-a61d-34673ee587fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Acquiring lock "cinder-quobyte-7be35a27-5631-45db-a61d-34673ee587fc" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "cinder-quobyte-7be35a27-5631-45db-a61d-34673ee587fc" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f926cc-b814-4e8a-aef1-37201f35976f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack sudo[113530]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950 Aug 25 07:06:35 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:35 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc Aug 25 07:06:35 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5a97b32c-e802-4ea4-9345-731b5278a950" returned: 0 in 0.253s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "cinder-quobyte-5a97b32c-e802-4ea4-9345-731b5278a950" released by "delete_volume" :: held 0.695s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Created reservations ['aee45c34-86fd-4b03-966e-fd55f93c66e8', '550b4643-c3fb-43b6-bada-888a2189f376', 'dd1bf80b-61f3-47a4-b302-97636c8c8205', 'e9344d34-0ec8-4be4-90de-3d240ca4ac02'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:36 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc" returned: 0 in 0.403s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc Aug 25 07:06:36 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:36 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-7be35a27-5631-45db-a61d-34673ee587fc" returned: 0 in 0.265s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "cinder-quobyte-7be35a27-5631-45db-a61d-34673ee587fc" released by "delete_volume" :: held 0.714s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:36 devstack cinder-volume[94487]: WARNING cinder.quota [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:06:36 devstack cinder-volume[94487]: WARNING cinder.quota [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:06:36 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.268s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Deleted volume successfully. Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Created reservations ['7e36df1f-2489-4768-b11b-9abf0ebdd701', 'd0ff5883-ffc1-4014-a131-2730fc85c3ef', 'aa07c59e-7985-434e-85c7-e9fde56f5007', '9b3b66f0-5b5b-4b01-8837-4be0c577b83e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-907c1509-0181-46a3-8a2d-ad2d94604942 tempest-ProjectReaderTests-612238839 None] Lock "cinder-5a97b32c-e802-4ea4-9345-731b5278a950-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:36 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Deleted volume successfully. Aug 25 07:06:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1aaa3ba4-8bd1-4905-8ea3-fd29bcf378b9 tempest-VolumeAndVolumeTypeFromImageTest-1426028898 None] Lock "cinder-7be35a27-5631-45db-a61d-34673ee587fc-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (2b163153-59f0-4370-8fad-18d54569c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1b8cf6-07b5-404e-8a43-9c0d9504665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1b8cf6-07b5-404e-8a43-9c0d9504665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914622431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddfe0d6-2663-44aa-ac31-8cc1b731e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:41Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cf357b-4d99-4d5b-af1b-2e94c3dc1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cf357b-4d99-4d5b-af1b-2e94c3dc1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4def6d-c674-4920-a963-250e6065e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4def6d-c674-4920-a963-250e6065e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fddfe0d6-2663-44aa-ac31-8cc1b731e57c', 'volume_name': 'volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970b9d6a-c5bd-4991-9054-e630591aeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970b9d6a-c5bd-4991-9054-e630591aeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:40 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ad24c-a117-4adc-9d53-53758f58e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:40 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Volume fddfe0d6-2663-44aa-ac31-8cc1b731e57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c', 'volume_size': 1} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914622431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddfe0d6-2663-44aa-ac31-8cc1b731e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:41Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Creating volume fddfe0d6-2663-44aa-ac31-8cc1b731e57c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[113554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c 1073741824 Aug 25 07:06:41 devstack sudo[113554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (1e601f62-4a8e-4cc1-979a-9caf0954db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97248255-9274-4616-b5c2-5c0e711aaada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97248255-9274-4616-b5c2-5c0e711aaada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21834184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1247161b-808f-415c-90be-b17564c90bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:41Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b09935-5e56-4ee7-84aa-b55e96ed2622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b09935-5e56-4ee7-84aa-b55e96ed2622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29b573b-ca0b-49b1-a96d-98a713a7a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29b573b-ca0b-49b1-a96d-98a713a7a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1247161b-808f-415c-90be-b17564c90bd5', 'volume_name': 'volume-1247161b-808f-415c-90be-b17564c90bd5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c9e9a6-6d71-4cab-9d1d-daeb5ae113c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c9e9a6-6d71-4cab-9d1d-daeb5ae113c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdcbc7b-e5e4-4271-baf5-a5620bfdb45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Volume 1247161b-808f-415c-90be-b17564c90bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1247161b-808f-415c-90be-b17564c90bd5', 'volume_size': 1} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack sudo[113554]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c 1073741824" returned: 0 in 0.495s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c Aug 25 07:06:41 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (a4e7fdee-93e2-40f0-b785-58929c1ee710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8839816-a0c8-45ad-8118-c824d07134b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8839816-a0c8-45ad-8118-c824d07134b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1303528472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55003b35-8f1a-4c16-9827-d6613daf2a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20abb835-f421-4467-9afa-f392e1159af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20abb835-f421-4467-9afa-f392e1159af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee433b0-90db-4c20-b646-94a81c5c0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee433b0-90db-4c20-b646-94a81c5c0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55003b35-8f1a-4c16-9827-d6613daf2a59', 'volume_name': 'volume-55003b35-8f1a-4c16-9827-d6613daf2a59', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746eb15a-8ada-4b95-9858-2ad1d43d1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746eb15a-8ada-4b95-9858-2ad1d43d1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035d4c12-0631-45c0-8612-8da8537547ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Volume 55003b35-8f1a-4c16-9827-d6613daf2a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55003b35-8f1a-4c16-9827-d6613daf2a59', 'volume_size': 1} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" returned: 0 in 0.328s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21834184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1247161b-808f-415c-90be-b17564c90bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:41Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Creating volume 1247161b-808f-415c-90be-b17564c90bd5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ad24c-a117-4adc-9d53-53758f58e786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adbb4a6-0e08-42fc-9091-784cdc8a9dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:41 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 1073741824 Aug 25 07:06:41 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Volume volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c (fddfe0d6-2663-44aa-ac31-8cc1b731e57c): created successfully Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adbb4a6-0e08-42fc-9091-784cdc8a9dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (2b163153-59f0-4370-8fad-18d54569c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-14074846-c6b5-468d-aeb9-650aa571fb6b tempest-ProjectReaderTests-401122014 None] Created volume successfully. Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (560f606a-5e39-4ad6-ab06-bc4a94d8af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1b7e25-4fd1-4989-a620-0151ace93308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1b7e25-4fd1-4989-a620-0151ace93308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-89157367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f719fc95-1931-4052-a6a7-de61f8d55b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add86a8d-3db4-433a-ba3b-a8bad7b915c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add86a8d-3db4-433a-ba3b-a8bad7b915c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ae7dc4-de31-421a-91a7-ae212856769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ae7dc4-de31-421a-91a7-ae212856769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f719fc95-1931-4052-a6a7-de61f8d55b0b', 'volume_name': 'volume-f719fc95-1931-4052-a6a7-de61f8d55b0b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4f3572-0e69-4b11-85d0-be3c7efce36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4f3572-0e69-4b11-85d0-be3c7efce36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e7acd4-209b-440a-8840-70fcebfb7f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Volume f719fc95-1931-4052-a6a7-de61f8d55b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f719fc95-1931-4052-a6a7-de61f8d55b0b', 'volume_size': 1} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:42 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 1073741824" returned: 0 in 0.523s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (85dc21bb-c29a-4158-a221-15d1e20abe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d5fd0b-6a52-4f1f-9499-9def1414ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d5fd0b-6a52-4f1f-9499-9def1414ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117865686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2132f207-c9aa-45b7-9968-3f0d2f4f83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a6ae1-0216-4778-acb6-d494e5a59d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a6ae1-0216-4778-acb6-d494e5a59d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1d2e1b-be19-41be-9ceb-f8a8f30b8335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1d2e1b-be19-41be-9ceb-f8a8f30b8335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2132f207-c9aa-45b7-9968-3f0d2f4f83e9', 'volume_name': 'volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c784bca-f05a-412a-b5a2-5a14b800ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c784bca-f05a-412a-b5a2-5a14b800ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd27ea6-65b2-4688-9ad5-ab0817d3c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Volume 2132f207-c9aa-45b7-9968-3f0d2f4f83e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9', 'volume_size': 1} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[113569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 Aug 25 07:06:42 devstack sudo[113569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (5acd7e43-206a-48f8-a145-b80172f94484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02abde1d-0221-4df5-8ca8-beeebc6c206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack sudo[113569]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5" returned: 0 in 0.268s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1303528472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55003b35-8f1a-4c16-9827-d6613daf2a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Creating volume 55003b35-8f1a-4c16-9827-d6613daf2a59 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02abde1d-0221-4df5-8ca8-beeebc6c206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084684646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4797102b-7ce0-43a6-a458-a4795424afd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:43Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack sudo[113572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 1073741824 Aug 25 07:06:42 devstack sudo[113572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1f5bfc-dc90-4e64-abfb-591a83f45dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1f5bfc-dc90-4e64-abfb-591a83f45dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f630baf-d53b-421f-a358-709ccdeec54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f630baf-d53b-421f-a358-709ccdeec54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4797102b-7ce0-43a6-a458-a4795424afd4', 'volume_name': 'volume-4797102b-7ce0-43a6-a458-a4795424afd4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e231b48-949e-49e4-a902-55698253d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e231b48-949e-49e4-a902-55698253d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf90818-9682-4635-b1ef-c0ef73a1dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Volume 4797102b-7ce0-43a6-a458-a4795424afd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4797102b-7ce0-43a6-a458-a4795424afd4', 'volume_size': 1} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdcbc7b-e5e4-4271-baf5-a5620bfdb45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1247161b-808f-415c-90be-b17564c90bd5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012509c2-b7f8-4d00-ab29-e77f5f47cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Volume volume-1247161b-808f-415c-90be-b17564c90bd5 (1247161b-808f-415c-90be-b17564c90bd5): created successfully Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012509c2-b7f8-4d00-ab29-e77f5f47cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (1e601f62-4a8e-4cc1-979a-9caf0954db06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fe174e66-5a40-4894-a8e6-5a78631c52ca tempest-CreateVolumesFromImageTest-1936073850 None] Created volume successfully. Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-fddfe0d6-2663-44aa-ac31-8cc1b731e57c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "cinder-fddfe0d6-2663-44aa-ac31-8cc1b731e57c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-quobyte-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce073fae-3762-45ba-8a62-39b11be08a53]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack sudo[113572]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 1073741824" returned: 0 in 0.490s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack sudo[113578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c Aug 25 07:06:43 devstack sudo[113578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 Aug 25 07:06:43 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59" returned: 0 in 0.253s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-89157367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f719fc95-1931-4052-a6a7-de61f8d55b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Creating volume f719fc95-1931-4052-a6a7-de61f8d55b0b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:43 devstack sudo[113578]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:43 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" returned: 0 in 0.371s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b 1073741824 Aug 25 07:06:43 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035d4c12-0631-45c0-8612-8da8537547ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55003b35-8f1a-4c16-9827-d6613daf2a59', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc2300c-14df-4950-a7ef-7510610ca0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:43 devstack sudo[113587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c Aug 25 07:06:43 devstack sudo[113587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Volume volume-55003b35-8f1a-4c16-9827-d6613daf2a59 (55003b35-8f1a-4c16-9827-d6613daf2a59): created successfully Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc2300c-14df-4950-a7ef-7510610ca0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (a4e7fdee-93e2-40f0-b785-58929c1ee710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:43 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b33d0d86-ae7e-4d15-a101-9d298b697c10 tempest-CreateVolumesFromImageTest-1936073850 None] Created volume successfully. Aug 25 07:06:43 devstack sudo[113587]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-fddfe0d6-2663-44aa-ac31-8cc1b731e57c" released by "delete_volume" :: held 0.679s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Created reservations ['6c0f2736-71c1-4dd7-bc96-a113cc7d34b0', '8fd03fcc-8b45-4501-a9d3-70b120a2da4a', 'f040dfb8-0a22-444f-9c24-a2ce68748ccf', 'e73b7e54-9a12-409f-ac68-f100ed1cc67c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:44 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:44 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b 1073741824" returned: 0 in 0.504s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[113597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b Aug 25 07:06:44 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:44 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Deleted volume successfully. Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-2435ed33-36d6-48e2-a5f0-f082ad945876 tempest-ProjectReaderTests-401122014 None] Lock "cinder-fddfe0d6-2663-44aa-ac31-8cc1b731e57c-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:44 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b" returned: 0 in 0.279s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117865686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2132f207-c9aa-45b7-9968-3f0d2f4f83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:42Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Creating volume 2132f207-c9aa-45b7-9968-3f0d2f4f83e9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:44 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 1073741824 Aug 25 07:06:44 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e7acd4-209b-440a-8840-70fcebfb7f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f719fc95-1931-4052-a6a7-de61f8d55b0b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd1699a-558f-4d0e-8ffa-5709a16df520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Volume volume-f719fc95-1931-4052-a6a7-de61f8d55b0b (f719fc95-1931-4052-a6a7-de61f8d55b0b): created successfully Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd1699a-558f-4d0e-8ffa-5709a16df520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (560f606a-5e39-4ad6-ab06-bc4a94d8af9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c8a6eec7-dbb6-4120-8079-34a2e87fa245 tempest-CreateVolumesFromImageTest-1936073850 None] Created volume successfully. Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (6dcfa4da-ff4b-4c11-bde7-e936e83e08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec090720-09ff-49b7-b0a5-2d6571ef0133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec090720-09ff-49b7-b0a5-2d6571ef0133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987161763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744c6868-c785-4974-a13b-dac8b9bc0ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:45Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e8d647-678e-4709-8f08-0f4a78cb4725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e8d647-678e-4709-8f08-0f4a78cb4725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d5020f-5f6a-4770-9a99-71b3abe65d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d5020f-5f6a-4770-9a99-71b3abe65d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744c6868-c785-4974-a13b-dac8b9bc0ee8', 'volume_name': 'volume-744c6868-c785-4974-a13b-dac8b9bc0ee8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9682224b-aa05-409a-933d-f170a4c6370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9682224b-aa05-409a-933d-f170a4c6370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1b6298-5875-4b10-a120-d9c35f6fa7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Volume 744c6868-c785-4974-a13b-dac8b9bc0ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744c6868-c785-4974-a13b-dac8b9bc0ee8', 'volume_size': 1} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 1073741824" returned: 0 in 0.491s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:45 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 Aug 25 07:06:45 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:45 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084684646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4797102b-7ce0-43a6-a458-a4795424afd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6627243dfd424f1195c351b0487c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:43Z,use_quota=True,user_id='d2e1b40937074c4fba082f1074e63339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Creating volume 4797102b-7ce0-43a6-a458-a4795424afd4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:45 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd27ea6-65b2-4688-9ad5-ab0817d3c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440c6992-72b7-4736-a3c0-f6e62e61d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:45 devstack sudo[113611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 1073741824 Aug 25 07:06:45 devstack sudo[113611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Volume volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 (2132f207-c9aa-45b7-9968-3f0d2f4f83e9): created successfully Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440c6992-72b7-4736-a3c0-f6e62e61d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (85dc21bb-c29a-4158-a221-15d1e20abe8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6273a7ff-c21d-4175-966c-907b3e2b6343 tempest-CreateVolumesFromImageTest-1936073850 None] Created volume successfully. Aug 25 07:06:45 devstack sudo[113611]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 1073741824" returned: 0 in 0.482s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:45 devstack sudo[113618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 Aug 25 07:06:45 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:46 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4" returned: 0 in 0.250s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987161763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744c6868-c785-4974-a13b-dac8b9bc0ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:45Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Creating volume 744c6868-c785-4974-a13b-dac8b9bc0ee8 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:46 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf90818-9682-4635-b1ef-c0ef73a1dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4797102b-7ce0-43a6-a458-a4795424afd4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:46 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 1073741824 Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446157f5-f185-40f6-b9eb-af27199ca9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:46 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:46 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Volume volume-4797102b-7ce0-43a6-a458-a4795424afd4 (4797102b-7ce0-43a6-a458-a4795424afd4): created successfully Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446157f5-f185-40f6-b9eb-af27199ca9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Flow 'volume_create_manager' (5acd7e43-206a-48f8-a145-b80172f94484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e9071a7f-61f1-4bca-99d2-bdf5b2474943 tempest-CreateVolumesFromImageTest-1936073850 None] Created volume successfully. Aug 25 07:06:46 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 1073741824" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:46 devstack sudo[113627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 Aug 25 07:06:46 devstack sudo[113627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:46 devstack sudo[113627]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8" returned: 0 in 0.250s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1b6298-5875-4b10-a120-d9c35f6fa7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744c6868-c785-4974-a13b-dac8b9bc0ee8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dcc02f-69f3-4a3a-bc13-44684f3fc4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:46 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Volume volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 (744c6868-c785-4974-a13b-dac8b9bc0ee8): created successfully Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dcc02f-69f3-4a3a-bc13-44684f3fc4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:46 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (6dcfa4da-ff4b-4c11-bde7-e936e83e08a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:46 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3e90d318-9794-411e-8287-a6588c982f76 tempest-ProjectReaderTests-401122014 None] Created volume successfully. Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-744c6868-c785-4974-a13b-dac8b9bc0ee8-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "cinder-744c6868-c785-4974-a13b-dac8b9bc0ee8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-quobyte-744c6868-c785-4974-a13b-dac8b9bc0ee8" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-744c6868-c785-4974-a13b-dac8b9bc0ee8" acquired by "delete_volume" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75ac33-5f50-4352-8ba6-29a422fcc5ed]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:47 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 Aug 25 07:06:47 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-4797102b-7ce0-43a6-a458-a4795424afd4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-4797102b-7ce0-43a6-a458-a4795424afd4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-quobyte-4797102b-7ce0-43a6-a458-a4795424afd4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-4797102b-7ce0-43a6-a458-a4795424afd4" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c50dfd-49e2-4569-912a-9b1684328600]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:47 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:47 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8 Aug 25 07:06:47 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:47 devstack sudo[113634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 Aug 25 07:06:47 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:47 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-744c6868-c785-4974-a13b-dac8b9bc0ee8" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-744c6868-c785-4974-a13b-dac8b9bc0ee8" released by "delete_volume" :: held 0.699s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:47 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:47 devstack sudo[113643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4 Aug 25 07:06:47 devstack sudo[113643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Created reservations ['56d88e11-e913-4a20-8595-33c3f7ba23dc', '0901c36f-dede-42ed-933e-69b84b11b26c', 'dbd0bf12-6248-458c-8ecc-2eeba4b6352c', '0608df99-611c-4a8e-afac-4b01dd8127ef'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:47 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:47 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:48 devstack sudo[113643]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4797102b-7ce0-43a6-a458-a4795424afd4" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-4797102b-7ce0-43a6-a458-a4795424afd4" released by "delete_volume" :: held 0.708s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Created reservations ['74171192-b805-4d7d-82fa-a77ba6ab8640', '55ce3443-9fb0-46ae-844b-656d1d1dfdbf', '499e9a96-2f23-4f87-a312-2e080eb29bb4', '79294439-6ed1-4662-985b-4933e5691dc3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:48 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Deleted volume successfully. Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9f686201-f5ee-4040-9bae-194d3b1c996c tempest-ProjectReaderTests-401122014 None] Lock "cinder-744c6868-c785-4974-a13b-dac8b9bc0ee8-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:48 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:48 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:48 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-2132f207-c9aa-45b7-9968-3f0d2f4f83e9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Deleted volume successfully. Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-2132f207-c9aa-45b7-9968-3f0d2f4f83e9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976889c9-77c2-4374-aef5-90ba3c6c2123 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-4797102b-7ce0-43a6-a458-a4795424afd4-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-quobyte-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a60e94f-80fa-4ff0-8d94-d8a35ae2a428]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (e268e46c-d5dd-4900-8041-db6283c3e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d675191e-0b39-4388-b21a-3496f81eee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d675191e-0b39-4388-b21a-3496f81eee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331147926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3934a0a7-7fd7-4135-a3a2-e9c1610905f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:49Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:48 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 Aug 25 07:06:48 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d9ec94-b791-4c0a-8c44-46cdc8c60aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d9ec94-b791-4c0a-8c44-46cdc8c60aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ddf595-8eda-4d83-91e3-14717f5b7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ddf595-8eda-4d83-91e3-14717f5b7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3934a0a7-7fd7-4135-a3a2-e9c1610905f7', 'volume_name': 'volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54fe246-f402-4d0e-9670-b214e15e5e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54fe246-f402-4d0e-9670-b214e15e5e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96579031-4181-4e07-9311-4301237741e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Volume 3934a0a7-7fd7-4135-a3a2-e9c1610905f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7', 'volume_size': 1} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331147926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3934a0a7-7fd7-4135-a3a2-e9c1610905f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:49Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Creating volume 3934a0a7-7fd7-4135-a3a2-e9c1610905f7 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:48 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:48 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 1073741824 Aug 25 07:06:48 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:49 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9 Aug 25 07:06:49 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:49 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 1073741824" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 Aug 25 07:06:49 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" returned: 0 in 0.262s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-2132f207-c9aa-45b7-9968-3f0d2f4f83e9" released by "delete_volume" :: held 0.720s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Created reservations ['43e4ae30-5038-4ccb-8273-c26ea3164cae', '9107256d-3806-4be3-bb51-4f7d960fefba', '4aae4cba-ca1f-4627-b204-f63981131cf9', '9a677f40-cb3e-4880-9d6d-02a32b0d47bc'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:49 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:49 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96579031-4181-4e07-9311-4301237741e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab641ca-3e67-4590-a3fc-34c04e0b78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Volume volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 (3934a0a7-7fd7-4135-a3a2-e9c1610905f7): created successfully Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab641ca-3e67-4590-a3fc-34c04e0b78a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (e268e46c-d5dd-4900-8041-db6283c3e71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a758cc5e-5ca3-4b90-a1fb-c1729c8d3287 tempest-ProjectReaderTests-401122014 None] Created volume successfully. Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-f719fc95-1931-4052-a6a7-de61f8d55b0b-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-f719fc95-1931-4052-a6a7-de61f8d55b0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:49 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-quobyte-f719fc95-1931-4052-a6a7-de61f8d55b0b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.330s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Deleted volume successfully. Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-f719fc95-1931-4052-a6a7-de61f8d55b0b" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-3934a0a7-7fd7-4135-a3a2-e9c1610905f7-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b7e47599-b37f-48b6-80df-e5992cca4579 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-2132f207-c9aa-45b7-9968-3f0d2f4f83e9-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d9fa5-0586-4e77-99a7-4d08774f5ef6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "cinder-3934a0a7-7fd7-4135-a3a2-e9c1610905f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-quobyte-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf6b7e-26c3-4980-b9fd-615196392974]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b Aug 25 07:06:50 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 Aug 25 07:06:50 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b" returned: 0 in 0.390s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b Aug 25 07:06:50 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" returned: 0 in 0.374s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[113685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7 Aug 25 07:06:50 devstack sudo[113685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f719fc95-1931-4052-a6a7-de61f8d55b0b" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-f719fc95-1931-4052-a6a7-de61f8d55b0b" released by "delete_volume" :: held 0.684s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Created reservations ['e4f0f71e-1c14-4cf2-908c-c3138c15eaf4', '86a4436e-c88e-4a57-be34-66c96a7ff266', 'ba8699f7-c6d4-4d2a-aa4c-56fa72be9f73', '1370108e-8336-4c4b-93c7-795d2dc295b9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:50 devstack sudo[113685]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-3934a0a7-7fd7-4135-a3a2-e9c1610905f7" released by "delete_volume" :: held 0.669s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:50 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Created reservations ['474b743d-9642-45c9-bb35-7f8f955ef725', 'cd50c836-11bb-47aa-ab3c-900cfbfe49d9', 'db8b152d-2632-47e5-a6ca-1dde44792ecf', '59047b7b-5ad6-4d50-9648-25a14b7e8ede'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[113691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:50 devstack sudo[113691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.261s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Deleted volume successfully. Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-55003b35-8f1a-4c16-9827-d6613daf2a59-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c79697ad-0cf4-495b-96e7-2ba7d1974ffa tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-f719fc95-1931-4052-a6a7-de61f8d55b0b-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-55003b35-8f1a-4c16-9827-d6613daf2a59-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:51 devstack sudo[113691]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-quobyte-55003b35-8f1a-4c16-9827-d6613daf2a59" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Deleted volume successfully. Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-55003b35-8f1a-4c16-9827-d6613daf2a59" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a5bdda9d-2905-4256-b095-aacd2f9de1e7 tempest-ProjectReaderTests-401122014 None] Lock "cinder-3934a0a7-7fd7-4135-a3a2-e9c1610905f7-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c1580-f0e5-43a0-b019-b89a4e496300]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 Aug 25 07:06:51 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59 Aug 25 07:06:51 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (d677f8e2-8307-4b5d-9206-041d3e6d961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbffc7fa-9498-45e9-9e54-cda29cd063b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbffc7fa-9498-45e9-9e54-cda29cd063b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94237419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ead959-4348-4f27-b2a2-05b9eaf1c17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:51Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e476701f-8c6d-4e23-b395-b31cdabbc92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e476701f-8c6d-4e23-b395-b31cdabbc92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feace483-f5dd-4f34-8251-03410d33695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feace483-f5dd-4f34-8251-03410d33695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ead959-4348-4f27-b2a2-05b9eaf1c17c', 'volume_name': 'volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8f9854-60ec-4e8b-a160-20d2884f5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8f9854-60ec-4e8b-a160-20d2884f5a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d857d8d-f1d6-4027-b1e2-53c31c779514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Volume 30ead959-4348-4f27-b2a2-05b9eaf1c17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c', 'volume_size': 1} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94237419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ead959-4348-4f27-b2a2-05b9eaf1c17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a56c8fbc154d018c3c49db1e1c6542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:51Z,use_quota=True,user_id='2facdec9390548a1822e4192afe1cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Creating volume 30ead959-4348-4f27-b2a2-05b9eaf1c17c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[113702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c 1073741824 Aug 25 07:06:51 devstack sudo[113702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-55003b35-8f1a-4c16-9827-d6613daf2a59" returned: 0 in 0.258s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-55003b35-8f1a-4c16-9827-d6613daf2a59" released by "delete_volume" :: held 0.687s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Created reservations ['241299ba-b373-4e1d-819b-c60ea4675f25', 'f5af87b5-6151-4a06-87e8-4e541b9153e2', '608e1637-de5e-4722-b18b-6addad4194f4', '2b411ebc-25b3-48b6-8523-5f635a5218d9'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:52 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:52 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:52 devstack sudo[113702]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c 1073741824" returned: 0 in 0.476s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-1247161b-808f-415c-90be-b17564c90bd5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-1247161b-808f-415c-90be-b17564c90bd5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:52 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c Aug 25 07:06:52 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "cinder-quobyte-1247161b-808f-415c-90be-b17564c90bd5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-1247161b-808f-415c-90be-b17564c90bd5" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:52 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.308s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Deleted volume successfully. Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d039314-f55a-4a2d-91e4-b3dea395914d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-feed2474-c5e8-48f0-9cbc-1b9f66ed6570 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-55003b35-8f1a-4c16-9827-d6613daf2a59-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:52 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 Aug 25 07:06:52 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:52 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c" returned: 0 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d857d8d-f1d6-4027-b1e2-53c31c779514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c2a4f5-5d73-41f5-b0a7-78dc1df21d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Volume volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c (30ead959-4348-4f27-b2a2-05b9eaf1c17c): created successfully Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c2a4f5-5d73-41f5-b0a7-78dc1df21d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Flow 'volume_create_manager' (d677f8e2-8307-4b5d-9206-041d3e6d961e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd5570b8-81a4-47d8-9f43-845879a39a17 tempest-ProjectReaderTests-401122014 None] Created volume successfully. Aug 25 07:06:52 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5" returned: 0 in 0.386s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:52 devstack sudo[113719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5 Aug 25 07:06:52 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:52 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-1247161b-808f-415c-90be-b17564c90bd5" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-quobyte-1247161b-808f-415c-90be-b17564c90bd5" released by "delete_volume" :: held 0.673s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:52 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Created reservations ['c1f0a505-c962-48ad-8d61-e0f229988ea9', '9b9afb39-8b2f-483f-bf0c-145b58b6f322', '223191a0-9173-4edf-b356-8d88128e3cb1', '7eb90444-7b2e-44be-b63f-1cdd5eecd635'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:53 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:53 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:53 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.251s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Deleted volume successfully. Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3f3cacac-dcad-48a8-9929-508e133e5043 tempest-CreateVolumesFromImageTest-1936073850 None] Lock "cinder-1247161b-808f-415c-90be-b17564c90bd5-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-30ead959-4348-4f27-b2a2-05b9eaf1c17c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "cinder-30ead959-4348-4f27-b2a2-05b9eaf1c17c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Acquiring lock "cinder-quobyte-30ead959-4348-4f27-b2a2-05b9eaf1c17c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-30ead959-4348-4f27-b2a2-05b9eaf1c17c" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0c59d-ac02-4e37-b767-3fb267e9bf34]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:53 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c Aug 25 07:06:53 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:54 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c" returned: 0 in 0.387s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:54 devstack sudo[113730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c Aug 25 07:06:54 devstack sudo[113730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:54 devstack sudo[113730]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-30ead959-4348-4f27-b2a2-05b9eaf1c17c" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "cinder-quobyte-30ead959-4348-4f27-b2a2-05b9eaf1c17c" released by "delete_volume" :: held 0.701s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Created reservations ['d52b1f09-95fe-436c-83d5-4ea52c1b9297', '90913b88-563e-4a2f-97be-f25de78bbb27', 'b148cf6e-0c70-48d2-8d46-3aa3f542fd55', 'c309b6de-4ee6-411f-964a-c1ddab885fd6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:54 devstack sudo[113733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:06:54 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:54 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.305s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Deleted volume successfully. Aug 25 07:06:54 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-48609f00-570a-4371-8772-50b1bcb9830f tempest-ProjectReaderTests-401122014 None] Lock "cinder-30ead959-4348-4f27-b2a2-05b9eaf1c17c-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (b114922a-5bda-46b4-9ea8-18b38d34dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc827675-c069-4c99-852d-9aa5e2b7a830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc827675-c069-4c99-852d-9aa5e2b7a830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435346790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09480540-1c24-4f77-93d9-87095efb48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:57Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3503d9c6-53fb-44f2-bef1-db8929eef854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3503d9c6-53fb-44f2-bef1-db8929eef854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8de003-9a55-4982-8b63-4543b2ca37c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8de003-9a55-4982-8b63-4543b2ca37c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09480540-1c24-4f77-93d9-87095efb48ef', 'volume_name': 'volume-09480540-1c24-4f77-93d9-87095efb48ef', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28528e34-7401-4406-9146-682c9b94bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28528e34-7401-4406-9146-682c9b94bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2c9a1f-f1c1-4d3a-b51f-a9f1b9941175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:56 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume 09480540-1c24-4f77-93d9-87095efb48ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09480540-1c24-4f77-93d9-87095efb48ef', 'volume_size': 1} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435346790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09480540-1c24-4f77-93d9-87095efb48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:57Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume 09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:56 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:06:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:56 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef 1073741824 Aug 25 07:06:56 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:57 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef 1073741824" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:57 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef Aug 25 07:06:57 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:57 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef" returned: 0 in 0.281s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2c9a1f-f1c1-4d3a-b51f-a9f1b9941175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09480540-1c24-4f77-93d9-87095efb48ef', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec09e4-8267-43a3-9e8f-08fb668e2224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:57 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-09480540-1c24-4f77-93d9-87095efb48ef (09480540-1c24-4f77-93d9-87095efb48ef): created successfully Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec09e4-8267-43a3-9e8f-08fb668e2224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:57 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (b114922a-5bda-46b4-9ea8-18b38d34dedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-240b1c12-007d-4639-ad35-bd50e18baa10 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:06:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating offline snapshot 2d875590-05d8-4cc9-8b3c-7cce6545eb88 of volume 09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697fb47-291c-4ab4-97d4-3f76efe2b780]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:59 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef Aug 25 07:06:59 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:59 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:59 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 1G Aug 25 07:06:59 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:59 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 1G" returned: 0 in 0.394s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09480540-1c24-4f77-93d9-87095efb48ef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:59 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09480540-1c24-4f77-93d9-87095efb48ef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 Aug 25 07:06:59 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09480540-1c24-4f77-93d9-87095efb48ef -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 is being set with open permissions: ugo+rw Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[113805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 Aug 25 07:07:00 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88" returned: 0 in 0.240s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info Aug 25 07:07:00 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info is being set with open permissions: ugo+rw Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info Aug 25 07:07:00 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[113813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:00 devstack sudo[113813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.info" returned: 0 in 0.265s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c47556ba-23dc-472d-80b3-92761200ad41 tempest-CreateVolumesFromSnapshotTest-912146249 None] Create snapshot completed successfully Aug 25 07:07:01 devstack sudo[113813]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.258s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (a2c33121-80b6-40b1-ab44-0ed8b625a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e471eba-5693-49a3-a2d1-3433ea014b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e471eba-5693-49a3-a2d1-3433ea014b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044095496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e15ca6-a015-42d9-927c-87632f943dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e15ca6-a015-42d9-927c-87632f943dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4019b06a-5dc6-41a8-987f-0dc59fb30384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4019b06a-5dc6-41a8-987f-0dc59fb30384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4', 'volume_name': 'volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6be1513-aca4-4458-8cf2-d79b8e72c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6be1513-aca4-4458-8cf2-d79b8e72c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65808876-974a-42a6-a18b-9a298e8ee146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4', 'volume_size': 1} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044095496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:01 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:01 devstack sudo[113817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 1073741824 Aug 25 07:07:01 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (08882ac9-b179-49f2-b0b0-968001667f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b10f514-548a-486b-b4e0-aaa617f0c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b10f514-548a-486b-b4e0-aaa617f0c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860476376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab5b147-3627-4aac-af90-826ee2cfddb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd721048-1d3f-4e21-b6fc-f17b537ec8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd721048-1d3f-4e21-b6fc-f17b537ec8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafbdd93-d71e-47a9-8cfa-0f3074585284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafbdd93-d71e-47a9-8cfa-0f3074585284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab5b147-3627-4aac-af90-826ee2cfddb8', 'volume_name': 'volume-eab5b147-3627-4aac-af90-826ee2cfddb8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138aa7a9-2f72-4884-9303-8b13afd12322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138aa7a9-2f72-4884-9303-8b13afd12322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf40cf40-4e69-41a1-ad5b-713a15b7ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume eab5b147-3627-4aac-af90-826ee2cfddb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab5b147-3627-4aac-af90-826ee2cfddb8', 'volume_size': 1} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:02 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 1073741824" returned: 0 in 0.527s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:02 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 Aug 25 07:07:02 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (3818be6a-8969-438c-8053-752c105723f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee19e6e-72d8-42e2-9871-551d2e8a9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee19e6e-72d8-42e2-9871-551d2e8a9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659254616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb65120b-079e-419b-b94b-10bcf8fb1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67503e00-227a-47b7-a761-a56b97b6ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67503e00-227a-47b7-a761-a56b97b6ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f1d363-82eb-4bee-88d2-ea0599935c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f1d363-82eb-4bee-88d2-ea0599935c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb65120b-079e-419b-b94b-10bcf8fb1685', 'volume_name': 'volume-bb65120b-079e-419b-b94b-10bcf8fb1685', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0313bf-f660-4d5c-8166-f5d1174db778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0313bf-f660-4d5c-8166-f5d1174db778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767a2b4-d178-47fe-a04c-51cc87970222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume bb65120b-079e-419b-b94b-10bcf8fb1685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb65120b-079e-419b-b94b-10bcf8fb1685', 'volume_size': 1} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:02 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860476376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab5b147-3627-4aac-af90-826ee2cfddb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume eab5b147-3627-4aac-af90-826ee2cfddb8 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:02 devstack sudo[113826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 1073741824 Aug 25 07:07:02 devstack sudo[113826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65808876-974a-42a6-a18b-9a298e8ee146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3a49dd-91da-452b-ad71-4f1fb77ebd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 (fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4): created successfully Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3a49dd-91da-452b-ad71-4f1fb77ebd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (a2c33121-80b6-40b1-ab44-0ed8b625a504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-133b1b56-2440-4ba9-af0c-8ff0bd0b0e6c tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (421efe42-1aaf-4b2b-ae50-ac594f2e0e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0cade-d493-449e-9343-633ae7608ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0cade-d493-449e-9343-633ae7608ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030356528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7962048-74d0-4e37-98d7-6611def6604e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:03Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94130d92-eed8-4e81-a4c2-1c1cb969294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94130d92-eed8-4e81-a4c2-1c1cb969294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e13fc75-610d-42bb-8834-7a944f4f69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e13fc75-610d-42bb-8834-7a944f4f69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7962048-74d0-4e37-98d7-6611def6604e', 'volume_name': 'volume-a7962048-74d0-4e37-98d7-6611def6604e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e1729-fe5e-4631-a4f6-bc90956e3af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e1729-fe5e-4631-a4f6-bc90956e3af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fddfad-64c4-46a1-87b0-0a763882cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume a7962048-74d0-4e37-98d7-6611def6604e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7962048-74d0-4e37-98d7-6611def6604e', 'volume_size': 1} Aug 25 07:07:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:03 devstack sudo[113826]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 1073741824" returned: 0 in 0.573s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:03 devstack sudo[113831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 Aug 25 07:07:03 devstack sudo[113831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (708d832a-d9bf-44a4-8990-a3352117862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755fde22-5ed4-4321-b1a8-c13153bc8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755fde22-5ed4-4321-b1a8-c13153bc8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562728350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ca486c-e221-4515-b4a1-71d9f4e94c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:03Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f335aedc-4852-47c8-aed0-7475acffdb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f335aedc-4852-47c8-aed0-7475acffdb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900a606-62c7-4f6f-99d8-95a67028fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900a606-62c7-4f6f-99d8-95a67028fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ca486c-e221-4515-b4a1-71d9f4e94c5b', 'volume_name': 'volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffb140c-76f0-49bc-9cdc-93013ba9fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffb140c-76f0-49bc-9cdc-93013ba9fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903bc46f-8f29-49ee-a670-427285f0d364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume 79ca486c-e221-4515-b4a1-71d9f4e94c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b', 'volume_size': 1} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:03 devstack sudo[113831]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659254616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb65120b-079e-419b-b94b-10bcf8fb1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:02Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume bb65120b-079e-419b-b94b-10bcf8fb1685 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:03 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf40cf40-4e69-41a1-ad5b-713a15b7ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab5b147-3627-4aac-af90-826ee2cfddb8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 1073741824 Aug 25 07:07:03 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642ee64d-d721-4f05-b9c6-0eba0d25320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-eab5b147-3627-4aac-af90-826ee2cfddb8 (eab5b147-3627-4aac-af90-826ee2cfddb8): created successfully Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642ee64d-d721-4f05-b9c6-0eba0d25320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (08882ac9-b179-49f2-b0b0-968001667f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-89e229b4-56c8-412f-8d62-945b560ffd6a tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:07:03 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 1073741824" returned: 0 in 0.430s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:03 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 Aug 25 07:07:03 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030356528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7962048-74d0-4e37-98d7-6611def6604e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:03Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume a7962048-74d0-4e37-98d7-6611def6604e {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767a2b4-d178-47fe-a04c-51cc87970222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb65120b-079e-419b-b94b-10bcf8fb1685', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:04 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e 1073741824 Aug 25 07:07:04 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4e2d40-60af-440a-b293-3387192abb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-bb65120b-079e-419b-b94b-10bcf8fb1685 (bb65120b-079e-419b-b94b-10bcf8fb1685): created successfully Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4e2d40-60af-440a-b293-3387192abb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (3818be6a-8969-438c-8053-752c105723f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-68f12fea-4954-4f09-b865-1d7495d0b219 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:07:04 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e 1073741824" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:04 devstack sudo[113849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e Aug 25 07:07:04 devstack sudo[113849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack sudo[113849]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e" returned: 0 in 0.240s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562728350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ca486c-e221-4515-b4a1-71d9f4e94c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad162625724d2d895bacb644a51c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:03Z,use_quota=True,user_id='6a0072123fba42c0a243502a44a59780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Creating volume 79ca486c-e221-4515-b4a1-71d9f4e94c5b {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fddfad-64c4-46a1-87b0-0a763882cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7962048-74d0-4e37-98d7-6611def6604e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eedb40e-ab15-4569-94bf-9d882f40c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:04 devstack sudo[113852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b 1073741824 Aug 25 07:07:04 devstack sudo[113852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-a7962048-74d0-4e37-98d7-6611def6604e (a7962048-74d0-4e37-98d7-6611def6604e): created successfully Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eedb40e-ab15-4569-94bf-9d882f40c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:04 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (421efe42-1aaf-4b2b-ae50-ac594f2e0e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-14a38326-7839-466e-a736-0450f7290c1d tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:07:05 devstack sudo[113852]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b 1073741824" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:05 devstack sudo[113858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b Aug 25 07:07:05 devstack sudo[113858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:05 devstack sudo[113858]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b" returned: 0 in 0.246s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903bc46f-8f29-49ee-a670-427285f0d364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88800edd-1d2a-4ca4-95db-2e8659b75b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Volume volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b (79ca486c-e221-4515-b4a1-71d9f4e94c5b): created successfully Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88800edd-1d2a-4ca4-95db-2e8659b75b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Flow 'volume_create_manager' (708d832a-d9bf-44a4-8990-a3352117862b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:05 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fa77263e-2ff1-4580-a2ab-67192a885062 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created volume successfully. Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-79ca486c-e221-4515-b4a1-71d9f4e94c5b-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-79ca486c-e221-4515-b4a1-71d9f4e94c5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-79ca486c-e221-4515-b4a1-71d9f4e94c5b" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-79ca486c-e221-4515-b4a1-71d9f4e94c5b" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eadec9-9317-4f0c-af8c-379035ca7374]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:06 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b Aug 25 07:07:06 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:07 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b" returned: 0 in 0.369s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:07 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b Aug 25 07:07:07 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:07 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-79ca486c-e221-4515-b4a1-71d9f4e94c5b" returned: 0 in 0.256s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-79ca486c-e221-4515-b4a1-71d9f4e94c5b" released by "delete_volume" :: held 0.662s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['e64fa75b-f840-47ee-87b0-e43f251ed90b', 'fd6aaddc-a01c-48fc-b54c-68439626de51', '376dab09-b7b2-4964-b0ce-6690eec20722', '1742530d-c64d-46d4-bb76-7e53dbbf69cd'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:07 devstack sudo[113869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:07 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:07 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.252s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cb1e2cf3-4bd2-45d4-a299-de9573c2d2fb tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-79ca486c-e221-4515-b4a1-71d9f4e94c5b-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-a7962048-74d0-4e37-98d7-6611def6604e-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-a7962048-74d0-4e37-98d7-6611def6604e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-a7962048-74d0-4e37-98d7-6611def6604e" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-a7962048-74d0-4e37-98d7-6611def6604e" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d53f29-2388-44a6-9865-0761817713b6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:07 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e Aug 25 07:07:07 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:08 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:08 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e Aug 25 07:07:08 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:08 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7962048-74d0-4e37-98d7-6611def6604e" returned: 0 in 0.246s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-a7962048-74d0-4e37-98d7-6611def6604e" released by "delete_volume" :: held 0.637s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['a31f92e3-1016-432c-88f4-f5c29580e2d2', 'd6252790-f290-43db-8a72-abc76a90c395', '709c4709-ed11-4bd0-bfc8-195ecae56b15', '85cbb407-ddfb-4392-84de-81318c98c520'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:08 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:08 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:08 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.248s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3c18cf1e-6e20-4f9d-b797-b8a11ec051b6 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-a7962048-74d0-4e37-98d7-6611def6604e-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-bb65120b-079e-419b-b94b-10bcf8fb1685-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:08 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-bb65120b-079e-419b-b94b-10bcf8fb1685-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-bb65120b-079e-419b-b94b-10bcf8fb1685" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-bb65120b-079e-419b-b94b-10bcf8fb1685" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e891bf-8028-4a4b-9406-53faaec9e7fc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:09 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 Aug 25 07:07:09 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:09 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:09 devstack sudo[113889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685 Aug 25 07:07:09 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:09 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-bb65120b-079e-419b-b94b-10bcf8fb1685" returned: 0 in 0.239s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-bb65120b-079e-419b-b94b-10bcf8fb1685" released by "delete_volume" :: held 0.627s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['7cd249e9-64f5-4f74-ba2c-3a239f69180c', '2233a70a-f0ce-4542-898f-de5dc6ba7a27', '390490d1-a16b-4fd1-abb8-01143cfc8ae8', 'b4d87811-5520-40bd-89d5-6c43544c4aab'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:09 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:09 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:09 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.241s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:10 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f3f8c030-1e76-4422-a198-8fbd7a71e607 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-bb65120b-079e-419b-b94b-10bcf8fb1685-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-eab5b147-3627-4aac-af90-826ee2cfddb8-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-eab5b147-3627-4aac-af90-826ee2cfddb8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-eab5b147-3627-4aac-af90-826ee2cfddb8" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-eab5b147-3627-4aac-af90-826ee2cfddb8" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4e066-c6b2-463b-905b-f43896fc74c0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:10 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 Aug 25 07:07:10 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:10 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:10 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8 Aug 25 07:07:10 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:10 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eab5b147-3627-4aac-af90-826ee2cfddb8" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-eab5b147-3627-4aac-af90-826ee2cfddb8" released by "delete_volume" :: held 0.657s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['edbcb54f-cd39-467a-8827-171733548dbb', '67f4af13-9453-4190-a04a-d5b41bcc8109', 'fa6896aa-0be3-4aa8-858f-f05ed9618580', '3e5b54da-1541-426a-b8e9-d99f3d1f60cb'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:10 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:10 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:11 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.270s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d731fb1-0dc8-4d11-bbb7-b43878b0d5ef tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-eab5b147-3627-4aac-af90-826ee2cfddb8-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26542ae-64ab-445e-8501-a7ac9a3fcf02]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:11 devstack sudo[113906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 Aug 25 07:07:11 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:11 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" returned: 0 in 0.414s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:11 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4 Aug 25 07:07:11 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:12 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4" released by "delete_volume" :: held 0.706s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['dc7380a3-2518-4a30-83ed-8f64eca6598c', '3b426163-1f9c-456b-a293-8fe37b81e422', 'accc19b6-4526-4231-8639-1b5c8b57d298', 'c440062d-3e18-4cdd-81a9-6ead34de0001'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:12 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:12 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-2d875590-05d8-4cc9-8b3c-7cce6545eb88-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-2d875590-05d8-4cc9-8b3c-7cce6545eb88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:12 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-2d875590-05d8-4cc9-8b3c-7cce6545eb88" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-80525f29-8f61-44f3-8490-15ce0e80e6de tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-fa495af8-1aa4-4cf2-b75c-f1bdcd430ad4-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-2d875590-05d8-4cc9-8b3c-7cce6545eb88" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleting offline snapshot 2d875590-05d8-4cc9-8b3c-7cce6545eb88 of volume 09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] snapshot_file for this snap is: volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b382f-d3dd-4029-9989-1fe4219f33fb]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:12 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 Aug 25 07:07:12 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:12 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88" returned: 0 in 0.363s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09480540-1c24-4f77-93d9-87095efb48ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23bdeb-4e11-4a26-99c5-423f3fcf4061]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:13 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef Aug 25 07:07:13 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:13 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef" returned: 0 in 0.363s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:13 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 Aug 25 07:07:13 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:13 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88" returned: 0 in 0.339s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:13 devstack sudo[113933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88 Aug 25 07:07:13 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:13 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef.2d875590-05d8-4cc9-8b3c-7cce6545eb88" returned: 0 in 0.257s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-2d875590-05d8-4cc9-8b3c-7cce6545eb88" released by "_delete_snapshot" :: held 1.422s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" released by "delete_snapshot" :: held 1.456s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['74f7c23f-58db-4d07-bba8-606d3c7484c1', '5508a3df-4b81-4882-b323-29a2803552b7', '0dfffe58-9cbc-4704-b60c-7a3f64d493c9', '9946a7cc-5742-4c89-b05c-0536d7888d2e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Delete snapshot completed successfully. Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e4b0454-8f7e-4675-876c-89a654e4925a tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-2d875590-05d8-4cc9-8b3c-7cce6545eb88-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-09480540-1c24-4f77-93d9-87095efb48ef-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-09480540-1c24-4f77-93d9-87095efb48ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" acquired by "delete_volume" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b447d31-eb4c-4902-894d-c3883d8a9e6f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:14 devstack sudo[113936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef Aug 25 07:07:14 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:15 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:15 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef Aug 25 07:07:15 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:15 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-09480540-1c24-4f77-93d9-87095efb48ef" returned: 0 in 0.256s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-quobyte-09480540-1c24-4f77-93d9-87095efb48ef" released by "delete_volume" :: held 0.680s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Created reservations ['976308ff-5d73-452b-8fdd-e6e2dcc402bf', '04a39183-cafd-4f52-ad2d-701ab07fbd53', 'ae2352a0-792d-4d0c-a22f-a0de513b417e', '2581f334-1786-4a5e-8b8e-93852681d473'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:15 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:15 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:15 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Deleted volume successfully. Aug 25 07:07:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-254b2a18-d107-49fc-a1e4-c67361576720 tempest-CreateVolumesFromSnapshotTest-912146249 None] Lock "cinder-09480540-1c24-4f77-93d9-87095efb48ef-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Flow 'volume_create_manager' (8ba39c36-a9a4-483f-bb0a-d1f1a2e70c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712cfc1e-3c2e-4656-ad77-f7b8fa8b6827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712cfc1e-3c2e-4656-ad77-f7b8fa8b6827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5dee0c-d93c-4c3b-ad53-f7355c070c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af1f8e1159e42e1a4a0fef4092f81da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:21Z,use_quota=True,user_id='835b65bf1b1b40e48ed871664252a7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92236c31-e953-4566-9e0b-ae43c70defc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92236c31-e953-4566-9e0b-ae43c70defc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10b30c-91f3-4868-a638-36838dcad614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:20 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10b30c-91f3-4868-a638-36838dcad614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb5dee0c-d93c-4c3b-ad53-f7355c070c7a', 'volume_name': 'volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a', 'volume_size': 1, 'image_id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebfe27f7779429b8e1adbca2bca9e248', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9af1f8e1159e42e1a4a0fef4092f81da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb9546280c2b81bf38c6c48183c41a44734cbf17509bf1835a92915c6029da5dd5225afac0794a500f02263fd39e3c73ed92dd05d5197aa86a760e39d4c8da6', 'id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/279f5f9c-885d-4250-b2e3-e91f5b460580/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044ec697-0ac5-4e36-ba6c-ec6e81a9a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044ec697-0ac5-4e36-ba6c-ec6e81a9a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6f4d4e-2118-4cce-b132-28e16f79675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a', 'volume_size': 1, 'image_id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebfe27f7779429b8e1adbca2bca9e248', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9af1f8e1159e42e1a4a0fef4092f81da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb9546280c2b81bf38c6c48183c41a44734cbf17509bf1835a92915c6029da5dd5225afac0794a500f02263fd39e3c73ed92dd05d5197aa86a760e39d4c8da6', 'id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/279f5f9c-885d-4250-b2e3-e91f5b460580/file', 'properties': {}}, 'image_service': } Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Trying to clone fb5dee0c-d93c-4c3b-ad53-f7355c070c7a from image 279f5f9c-885d-4250-b2e3-e91f5b460580 at location (None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:07:21 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1e411-54ff-4f3f-b1a5-236137c38b1c]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:21 devstack sudo[113948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:21 devstack sudo[113948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:21 devstack sudo[113948]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:21 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:21 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:22 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Temporary image 279f5f9c-885d-4250-b2e3-e91f5b460580 is fetched for user 835b65bf1b1b40e48ed871664252a7c4. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dee3977-4e6b-4360-8807-0ddd239ddb06]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:22 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:22 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:22 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:22 devstack sudo[113961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:22 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:22 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5dee0c-d93c-4c3b-ad53-f7355c070c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af1f8e1159e42e1a4a0fef4092f81da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:21Z,use_quota=True,user_id='835b65bf1b1b40e48ed871664252a7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Creating volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:22 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:22 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1073741824 Aug 25 07:07:22 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:23 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1073741824" returned: 0 in 0.444s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=168,cinder:INSERT=55,cinder:UPDATE=226,cinder:DELETE=19 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:23 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a Aug 25 07:07:23 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:23 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" returned: 0 in 0.252s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Attempting download of 279f5f9c-885d-4250-b2e3-e91f5b460580 ((None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}])) to volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97af620-5780-4330-837d-eedf489c7de3]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:23 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka Aug 25 07:07:23 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:23 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka" returned: 0 in 0.364s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:24 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka Aug 25 07:07:24 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:24 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka" returned: 1 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_279f5f9c-885d-4250-b2e3-e91f5b460580_psc4fyka' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e397466-d15b-428a-8eb7-3c3ba3962253]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:24 devstack sudo[113982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:24 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:24 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:24 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD Aug 25 07:07:24 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:24 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] 279f5f9c-885d-4250-b2e3-e91f5b460580 was raw, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:07:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:24 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a Aug 25 07:07:24 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:25 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_279f5f9c-885d-4250-b2e3-e91f5b460580_kraytsoqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:07:25 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:25 devstack sudo[113997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1G Aug 25 07:07:25 devstack sudo[113997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:25 devstack sudo[113997]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a 1G" returned: 0 in 0.293s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Downloaded image 279f5f9c-885d-4250-b2e3-e91f5b460580 ((None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}])) to volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Temporary image 279f5f9c-885d-4250-b2e3-e91f5b460580 for user 835b65bf1b1b40e48ed871664252a7c4 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Marking volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Copying metadata from image 279f5f9c-885d-4250-b2e3-e91f5b460580 to fb5dee0c-d93c-4c3b-ad53-f7355c070c7a. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Creating volume glance metadata for volume fb5dee0c-d93c-4c3b-ad53-f7355c070c7a backed by image 279f5f9c-885d-4250-b2e3-e91f5b460580 with: {'image_id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ebfe27f7779429b8e1adbca2bca9e248', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6f4d4e-2118-4cce-b132-28e16f79675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a', 'volume_size': 1, 'image_id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/279f5f9c-885d-4250-b2e3-e91f5b460580', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebfe27f7779429b8e1adbca2bca9e248', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9af1f8e1159e42e1a4a0fef4092f81da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb9546280c2b81bf38c6c48183c41a44734cbf17509bf1835a92915c6029da5dd5225afac0794a500f02263fd39e3c73ed92dd05d5197aa86a760e39d4c8da6', 'id': '279f5f9c-885d-4250-b2e3-e91f5b460580', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/279f5f9c-885d-4250-b2e3-e91f5b460580/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0b67a3-7adb-4718-b1ae-d4c762e94730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Volume volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a (fb5dee0c-d93c-4c3b-ad53-f7355c070c7a): created successfully Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0b67a3-7adb-4718-b1ae-d4c762e94730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Flow 'volume_create_manager' (8ba39c36-a9a4-483f-bb0a-d1f1a2e70c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c89010b1-e6eb-46ab-b2e9-77445e852378 tempest-VolumeImageDependencyTests-1925479054 None] Created volume successfully. Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Acquiring lock "cinder-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "cinder-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Acquiring lock "cinder-quobyte-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "cinder-quobyte-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" acquired by "delete_volume" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b39a55e-6cae-4b51-8840-18862374c82d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:26 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a Aug 25 07:07:26 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:26 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:26 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a Aug 25 07:07:26 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:26 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "cinder-quobyte-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a" released by "delete_volume" :: held 0.660s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:26 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Created reservations ['ff68ed28-72c9-4086-be02-79d5877dc132', '5c296fa0-0a7d-495f-9c91-e5376ab4886f', 'ad83e16c-b05d-4899-9091-3aed5e4c7805', 'c5698304-3d57-42fc-a10a-0d7b73b0cdd8'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:27 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:27 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:27 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.244s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Deleted volume successfully. Aug 25 07:07:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-fd963244-2a18-4054-b6ae-93fab1236b14 tempest-VolumeImageDependencyTests-1925479054 None] Lock "cinder-fb5dee0c-d93c-4c3b-ad53-f7355c070c7a-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:36 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=215,cinder:SELECT=142,cinder:INSERT=61,cinder:DELETE=20 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:07:37 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=10,cinder:SELECT=9,cinder:INSERT=9,cinder:DELETE=1 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (5c569479-01f6-4a83-9d8d-8fc853783df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a06421-d7dd-4fe0-9a1e-bd21df377ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a06421-d7dd-4fe0-9a1e-bd21df377ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-65085630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8a65be-45c0-47f3-a077-529308c45f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8a65be-45c0-47f3-a077-529308c45f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607773fd-9928-4de7-94b4-9bd5c7f439a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607773fd-9928-4de7-94b4-9bd5c7f439a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf', 'volume_name': 'volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327df094-f5e2-4494-8496-9f7d3db1b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327df094-f5e2-4494-8496-9f7d3db1b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd35c94-3d85-452f-9c7c-d0b414a8031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Volume 0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf', 'volume_size': 1} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-65085630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Creating volume 0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:48 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:49 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf 1073741824 Aug 25 07:07:49 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (21b32164-c9b2-4ede-9455-8959acafe205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416265ab-664a-466b-8e8a-04a30d71d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Flow 'volume_create_manager' (64f650ac-4249-4113-80e7-7c607edd7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b0e7e-32b6-4d8d-baad-2f98d9c67c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416265ab-664a-466b-8e8a-04a30d71d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-134652853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7192af1-3ec3-4c59-bb08-074637158679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31229469-c2e8-40e3-9c51-02fd10857db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31229469-c2e8-40e3-9c51-02fd10857db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b95242-494e-40a0-afc8-c58397ce4b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b95242-494e-40a0-afc8-c58397ce4b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7192af1-3ec3-4c59-bb08-074637158679', 'volume_name': 'volume-a7192af1-3ec3-4c59-bb08-074637158679', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e62bd2-5ebc-4826-8787-a2349b42e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e62bd2-5ebc-4826-8787-a2349b42e156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca92ca7-8640-4929-9540-27c8ea059f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Volume a7192af1-3ec3-4c59-bb08-074637158679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7192af1-3ec3-4c59-bb08-074637158679', 'volume_size': 1} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b0e7e-32b6-4d8d-baad-2f98d9c67c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-831279809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4bb88d-0066-45f0-892a-6deaec4abb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7c7a151e9c4bdca583585b4f16d147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='877f43ddfd6846cb89f3476052eb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eb6292-add8-4368-8fba-3ccf14ff4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eb6292-add8-4368-8fba-3ccf14ff4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eca6c54-965f-4c1d-a7cb-849c74e3ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eca6c54-965f-4c1d-a7cb-849c74e3ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4bb88d-0066-45f0-892a-6deaec4abb17', 'volume_name': 'volume-db4bb88d-0066-45f0-892a-6deaec4abb17', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20c413-7497-402f-9a2c-c43002974ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20c413-7497-402f-9a2c-c43002974ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9541ba0-13a4-4752-a08d-ef25ca78091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Volume db4bb88d-0066-45f0-892a-6deaec4abb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4bb88d-0066-45f0-892a-6deaec4abb17', 'volume_size': 1} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (6e82ccb9-1656-4143-ae0a-a570597b16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8885f74a-352d-41ff-8da2-7de4ed3a5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8885f74a-352d-41ff-8da2-7de4ed3a5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116056383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab777ea5-a119-40ed-9263-8426ca0b395f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ea3d1-9084-4f5e-9bf6-5a30b962182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ea3d1-9084-4f5e-9bf6-5a30b962182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5f1ea-18f3-4c91-b381-19a97b8af4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5f1ea-18f3-4c91-b381-19a97b8af4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab777ea5-a119-40ed-9263-8426ca0b395f', 'volume_name': 'volume-ab777ea5-a119-40ed-9263-8426ca0b395f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fd9f1c-9122-497b-a2f1-4029466ead86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fd9f1c-9122-497b-a2f1-4029466ead86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bad46f9-d96f-4402-9e9f-eeee10e33a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Volume ab777ea5-a119-40ed-9263-8426ca0b395f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab777ea5-a119-40ed-9263-8426ca0b395f', 'volume_size': 1} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf 1073741824" returned: 0 in 0.733s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:49 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf Aug 25 07:07:49 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (55462fb1-e2d0-4b63-ad1d-666acbaded44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9df87f-7985-4241-9623-43816204713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9df87f-7985-4241-9623-43816204713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871217881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c9a559-3ab7-45ad-a358-7c261af0ae26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e8d19f-ee23-4210-9c7f-a7ce6b048009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e8d19f-ee23-4210-9c7f-a7ce6b048009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddfd67e-d49b-4a56-a2ea-aef770aabfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddfd67e-d49b-4a56-a2ea-aef770aabfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6c9a559-3ab7-45ad-a358-7c261af0ae26', 'volume_name': 'volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635dbdfd-7c4a-4e5b-a15c-764a372430db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635dbdfd-7c4a-4e5b-a15c-764a372430db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36b329d-c169-4d1c-b6fe-e546ca6553c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Volume d6c9a559-3ab7-45ad-a358-7c261af0ae26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26', 'volume_size': 1} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:50 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" returned: 0 in 0.324s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-134652853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7192af1-3ec3-4c59-bb08-074637158679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Creating volume a7192af1-3ec3-4c59-bb08-074637158679 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:50 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd35c94-3d85-452f-9c7c-d0b414a8031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763a1b78-4cab-4c5c-b869-34001dacc66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 1073741824 Aug 25 07:07:50 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Volume volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf (0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf): created successfully Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763a1b78-4cab-4c5c-b869-34001dacc66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (5c569479-01f6-4a83-9d8d-8fc853783df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4cfbf876-6542-4b1d-a8a3-e5ee9fae553c tempest-CreateVolumesFromImageTest-1460687650 None] Created volume successfully. Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (0f71bae1-819f-4502-92b1-b76d0ffc83e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab2f0bd-09f8-4920-80a1-3eea0f92eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab2f0bd-09f8-4920-80a1-3eea0f92eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495714213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6111377b-9eed-46ae-88c4-f22cc516d587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf2d2e-80ab-4bf6-a16f-84ebea901cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf2d2e-80ab-4bf6-a16f-84ebea901cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217471d7-c0fe-4aa0-b051-dfff44b9b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217471d7-c0fe-4aa0-b051-dfff44b9b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6111377b-9eed-46ae-88c4-f22cc516d587', 'volume_name': 'volume-6111377b-9eed-46ae-88c4-f22cc516d587', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f30de9-6367-40ab-b2bc-c9409c300518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f30de9-6367-40ab-b2bc-c9409c300518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffe325-a940-47aa-9811-7943dcc56073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Volume 6111377b-9eed-46ae-88c4-f22cc516d587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6111377b-9eed-46ae-88c4-f22cc516d587', 'volume_size': 1} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:50 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 1073741824" returned: 0 in 0.622s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:50 devstack sudo[114076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 Aug 25 07:07:50 devstack sudo[114076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:51 devstack sudo[114076]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679" returned: 0 in 0.298s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-831279809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4bb88d-0066-45f0-892a-6deaec4abb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7c7a151e9c4bdca583585b4f16d147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:49Z,use_quota=True,user_id='877f43ddfd6846cb89f3476052eb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Creating volume db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca92ca7-8640-4929-9540-27c8ea059f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7192af1-3ec3-4c59-bb08-074637158679', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:51 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 1073741824 Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0270b6-1cdb-4335-bcf5-813bc6974db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:51 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Volume volume-a7192af1-3ec3-4c59-bb08-074637158679 (a7192af1-3ec3-4c59-bb08-074637158679): created successfully Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0270b6-1cdb-4335-bcf5-813bc6974db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (21b32164-c9b2-4ede-9455-8959acafe205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-62477e38-e39c-4d41-9f16-fbdb3617c680 tempest-CreateVolumesFromImageTest-1460687650 None] Created volume successfully. Aug 25 07:07:51 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 1073741824" returned: 0 in 0.609s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:51 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:07:51 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:52 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.300s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.331s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116056383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab777ea5-a119-40ed-9263-8426ca0b395f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Creating volume ab777ea5-a119-40ed-9263-8426ca0b395f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9541ba0-13a4-4752-a08d-ef25ca78091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4bb88d-0066-45f0-892a-6deaec4abb17', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776e69ea-9591-40ed-ae00-34c419853377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:52 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f 1073741824 Aug 25 07:07:52 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Volume volume-db4bb88d-0066-45f0-892a-6deaec4abb17 (db4bb88d-0066-45f0-892a-6deaec4abb17): created successfully Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776e69ea-9591-40ed-ae00-34c419853377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Flow 'volume_create_manager' (64f650ac-4249-4113-80e7-7c607edd7431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-19946330-71fd-48e0-b376-05f852d3a0e7 tempest-VolumeDependencyTests-1926714975 None] Created volume successfully. Aug 25 07:07:52 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f 1073741824" returned: 0 in 0.538s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:52 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f Aug 25 07:07:52 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:52 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f" returned: 0 in 0.325s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.908s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871217881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c9a559-3ab7-45ad-a358-7c261af0ae26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Creating volume d6c9a559-3ab7-45ad-a358-7c261af0ae26 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bad46f9-d96f-4402-9e9f-eeee10e33a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab777ea5-a119-40ed-9263-8426ca0b395f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf73b2-039c-434f-8966-0335cb79972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 1073741824 Aug 25 07:07:53 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Volume volume-ab777ea5-a119-40ed-9263-8426ca0b395f (ab777ea5-a119-40ed-9263-8426ca0b395f): created successfully Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf73b2-039c-434f-8966-0335cb79972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (6e82ccb9-1656-4143-ae0a-a570597b16fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Flow 'volume_create_manager' (7403207c-504e-4681-9fe5-b50c7162515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a208db04-e9c9-43c3-b350-ca518a61846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b42ab19d-b999-4d12-9105-c2d2db62accc tempest-CreateVolumesFromImageTest-1460687650 None] Created volume successfully. Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a208db04-e9c9-43c3-b350-ca518a61846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70536ecb-248e-4fab-bbc0-ba82ef9fe395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d6981092bb4d0ba5e0b56cb8da45f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:53Z,use_quota=True,user_id='e1809401a72c4637bb05fbfd9391dff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(471b2fe2-cdeb-42de-ac88-37755047f23a),volume_type_id=471b2fe2-cdeb-42de-ac88-37755047f23a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfd8cdf-c5c4-4353-bf78-21c700e0a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfd8cdf-c5c4-4353-bf78-21c700e0a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cea68c0-3e4b-4d6d-8303-2c1fe38c1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cea68c0-3e4b-4d6d-8303-2c1fe38c1981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70536ecb-248e-4fab-bbc0-ba82ef9fe395', 'volume_name': 'volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395', 'volume_size': 1, 'image_id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e15c575dffa75813bd09adeada4f61d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d6981092bb4d0ba5e0b56cb8da45f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4c4a8ae9ee6e244abe993cd0b52c891a4611e0ec614fa10dc78b7884e4aefb1e649b632be3fc1dbaf0d5c1985480e16f685b66927376efd6f8a341441044767', 'id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e562610-165b-48e7-b18b-d6896f909e8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d62e6c-8011-4875-9b6c-c15a45370d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d62e6c-8011-4875-9b6c-c15a45370d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac12d04-52fc-4460-9bab-4146c71c04f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395', 'volume_size': 1, 'image_id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e15c575dffa75813bd09adeada4f61d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d6981092bb4d0ba5e0b56cb8da45f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4c4a8ae9ee6e244abe993cd0b52c891a4611e0ec614fa10dc78b7884e4aefb1e649b632be3fc1dbaf0d5c1985480e16f685b66927376efd6f8a341441044767', 'id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e562610-165b-48e7-b18b-d6896f909e8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Trying to clone 70536ecb-248e-4fab-bbc0-ba82ef9fe395 from image 0e562610-165b-48e7-b18b-d6896f909e8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:07:53 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 1073741824" returned: 0 in 0.604s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:07:53 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:53 devstack sudo[114105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 Aug 25 07:07:53 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369d1b2-262d-416e-b3d7-a941e8c30c2c]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:53 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:53 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:53 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26" returned: 0 in 0.322s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.355s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495714213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6111377b-9eed-46ae-88c4-f22cc516d587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edbc1b6a33e4f219b0c322e512fa5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:50Z,use_quota=True,user_id='3253140a51784eb7b3248dfc0970db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Creating volume 6111377b-9eed-46ae-88c4-f22cc516d587 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:53 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36b329d-c169-4d1c-b6fe-e546ca6553c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:54 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 1073741824 Aug 25 07:07:54 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34b16ec-3c8e-4a96-adaa-96f3a3ec6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Volume volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 (d6c9a559-3ab7-45ad-a358-7c261af0ae26): created successfully Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34b16ec-3c8e-4a96-adaa-96f3a3ec6643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (55462fb1-e2d0-4b63-ad1d-666acbaded44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ff788d43-4c3b-4ad7-a5c1-330e60a7a74d tempest-CreateVolumesFromImageTest-1460687650 None] Created volume successfully. Aug 25 07:07:54 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:54 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Temporary image 0e562610-165b-48e7-b18b-d6896f909e8a is fetched for user e1809401a72c4637bb05fbfd9391dff6. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:07:54 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 1073741824" returned: 0 in 0.462s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d5b04b-4e7e-4d11-9a9c-9fba93b2d840]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack sudo[114122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 Aug 25 07:07:54 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:54 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.432s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffe325-a940-47aa-9811-7943dcc56073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6111377b-9eed-46ae-88c4-f22cc516d587', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f0ea83-7368-43a2-b83d-19c87ae431b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Creating offline snapshot 349a21d5-c4b3-4401-be8b-57aaa6e0d11e of volume db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:07:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Volume volume-6111377b-9eed-46ae-88c4-f22cc516d587 (6111377b-9eed-46ae-88c4-f22cc516d587): created successfully Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f0ea83-7368-43a2-b83d-19c87ae431b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Flow 'volume_create_manager' (0f71bae1-819f-4502-92b1-b76d0ffc83e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579e0de-d814-4c66-8500-22921fd27f0c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:54 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4d40b001-35f6-45d7-99ee-2d025f637ecf tempest-CreateVolumesFromImageTest-1460687650 None] Created volume successfully. Aug 25 07:07:54 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:07:54 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:55 devstack sudo[114130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:55 devstack sudo[114130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-6111377b-9eed-46ae-88c4-f22cc516d587-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-6111377b-9eed-46ae-88c4-f22cc516d587-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-quobyte-6111377b-9eed-46ae-88c4-f22cc516d587" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-6111377b-9eed-46ae-88c4-f22cc516d587" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:55 devstack sudo[114130]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff4bfb-8d0a-4acd-8b19-d2cc1a944929]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:55 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 1 in 0.500s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.522s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:55 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e 1G Aug 25 07:07:55 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:55 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 Aug 25 07:07:55 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:55 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587" returned: 0 in 0.446s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:55 devstack sudo[114149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587 Aug 25 07:07:55 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:55 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e 1G" returned: 0 in 0.505s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4bb88d-0066-45f0-892a-6deaec4abb17 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:55 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4bb88d-0066-45f0-892a-6deaec4abb17 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:07:55 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:56 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6111377b-9eed-46ae-88c4-f22cc516d587" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-6111377b-9eed-46ae-88c4-f22cc516d587" released by "delete_volume" :: held 0.790s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Created reservations ['b7fbedc4-6b09-41f1-9738-d7f618fac848', '8770d189-576e-4528-992c-977601a5069a', '62d8c676-88b4-4782-bd0b-2e6efbd73a89', '29d53caf-51b0-4a34-82dd-b8e28f27ebdf'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:56 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4bb88d-0066-45f0-892a-6deaec4abb17 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.436s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e is being set with open permissions: ugo+rw Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:56 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:56 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:56 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:07:56 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-d6c9a559-3ab7-45ad-a358-7c261af0ae26-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-d6c9a559-3ab7-45ad-a358-7c261af0ae26-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-quobyte-d6c9a559-3ab7-45ad-a358-7c261af0ae26" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-d6c9a559-3ab7-45ad-a358-7c261af0ae26" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ad36c-2314-49df-9a89-de277c069cb3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:56 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:56 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Deleted volume successfully. Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.359s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6e000a8a-a307-4ee2-b8f9-e37b2a4f9d6b tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-6111377b-9eed-46ae-88c4-f22cc516d587-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:56 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info Aug 25 07:07:56 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:56 devstack sudo[114163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 Aug 25 07:07:56 devstack sudo[114163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:57 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:57 devstack sudo[114163]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:57 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info is being set with open permissions: ugo+rw Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26" returned: 0 in 0.462s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:57 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info Aug 25 07:07:57 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:57 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26 Aug 25 07:07:57 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:57 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6c9a559-3ab7-45ad-a358-7c261af0ae26" returned: 0 in 0.307s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-d6c9a559-3ab7-45ad-a358-7c261af0ae26" released by "delete_volume" :: held 0.837s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:57 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.info" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70536ecb-248e-4fab-bbc0-ba82ef9fe395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d6981092bb4d0ba5e0b56cb8da45f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:53Z,use_quota=True,user_id='e1809401a72c4637bb05fbfd9391dff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(471b2fe2-cdeb-42de-ac88-37755047f23a),volume_type_id=471b2fe2-cdeb-42de-ac88-37755047f23a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Creating volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:57 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-36107037-165b-4a62-ad1a-bf5f5769e360 tempest-VolumeDependencyTests-1926714975 None] Create snapshot completed successfully Aug 25 07:07:57 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1073741824 Aug 25 07:07:57 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Created reservations ['e6eb2f82-e18a-4dbf-906c-3944a7d18746', '44d130f4-4734-4528-b504-879f9d20bea8', 'c53fa1af-611c-44ac-aa06-4dd0db7858c1', '22dbdd7b-8840-43be-8293-37dc7844a6c6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:57 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:07:57 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:58 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:58 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1073741824" returned: 0 in 0.545s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Deleted volume successfully. Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-11a86c85-d828-46af-ade6-8ba17b27f68d tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-d6c9a559-3ab7-45ad-a358-7c261af0ae26-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:58 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 Aug 25 07:07:58 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:58 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395" returned: 0 in 0.280s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Attempting download of 0e562610-165b-48e7-b18b-d6896f909e8a ((None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}])) to volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[12715ffb-f26a-41b9-b6b6-145cbfe43127]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:58 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj Aug 25 07:07:58 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-ab777ea5-a119-40ed-9263-8426ca0b395f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-ab777ea5-a119-40ed-9263-8426ca0b395f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:58 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj" returned: 0 in 0.413s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-quobyte-ab777ea5-a119-40ed-9263-8426ca0b395f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-ab777ea5-a119-40ed-9263-8426ca0b395f" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d4307-f98d-40ed-a9e9-61fd8613db06]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:59 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj Aug 25 07:07:59 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:59 devstack sudo[114231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f Aug 25 07:07:59 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Flow 'volume_create_manager' (98074913-2104-44e1-a519-83705c918fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:59 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60cdfaf-bcb6-4c36-8db3-f42c95ac2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj" returned: 1 in 0.507s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e562610-165b-48e7-b18b-d6896f909e8a_pkrytdbj' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568ac76-872e-4187-be01-405b59fc9509]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60cdfaf-bcb6-4c36-8db3-f42c95ac2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1908970605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4fe59e-bcce-4161-a71d-9843ffbd8271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7c7a151e9c4bdca583585b4f16d147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=349a21d5-c4b3-4401-be8b-57aaa6e0d11e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:59Z,use_quota=True,user_id='877f43ddfd6846cb89f3476052eb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa67acb-21f5-4c8d-958b-3b0f4eb51f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa67acb-21f5-4c8d-958b-3b0f4eb51f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96df1fd-ddb8-485d-96cb-3b9c30f3ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96df1fd-ddb8-485d-96cb-3b9c30f3ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f4fe59e-bcce-4161-a71d-9843ffbd8271', 'volume_name': 'volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271', 'volume_size': 1, 'snapshot_id': '349a21d5-c4b3-4401-be8b-57aaa6e0d11e'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0c75c0-9425-4540-9e27-d1fc43b0498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0c75c0-9425-4540-9e27-d1fc43b0498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95140bae-2f36-40c6-9eec-2011df0f171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:59 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Volume 4f4fe59e-bcce-4161-a71d-9843ffbd8271: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271', 'volume_size': 1, 'snapshot_id': '349a21d5-c4b3-4401-be8b-57aaa6e0d11e'} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-4f4fe59e-bcce-4161-a71d-9843ffbd8271" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-4f4fe59e-bcce-4161-a71d-9843ffbd8271" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Creating volume 4f4fe59e-bcce-4161-a71d-9843ffbd8271 from snapshot 349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:59 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:59 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] snapshot: 349a21d5-c4b3-4401-be8b-57aaa6e0d11e, volume: 4f4fe59e-bcce-4161-a71d-9843ffbd8271, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:07:59 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f" returned: 0 in 0.623s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9dfb7-3639-4998-8e05-c304968b63fd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:59 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f Aug 25 07:07:59 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:59 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:07:59 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:59 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:59 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-ab777ea5-a119-40ed-9263-8426ca0b395f" returned: 0 in 0.326s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-ab777ea5-a119-40ed-9263-8426ca0b395f" released by "delete_volume" :: held 1.006s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:59 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD Aug 25 07:07:59 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Created reservations ['043df6da-7329-4cc6-a49f-1b2b620b6b55', '84e24ec2-cb79-411c-82c6-8e327dc4f2ef', '5dc5162b-0173-4147-a5e2-c9091efe8972', '33b3d94b-7ba3-4853-9fe8-595647fd63a3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:00 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.521s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4bb88d-0066-45f0-892a-6deaec4abb17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9454cec1-2e24-4b66-a8d0-f8cdcd46dc70]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:00 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Flow 'volume_create_manager' (0bdd2dce-3ffc-4c55-8291-69223d63c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2679973b-ce65-4841-87d9-d2213c1c2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:00 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD" returned: 1 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] 0e562610-165b-48e7-b18b-d6896f909e8a was raw, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2679973b-ce65-4841-87d9-d2213c1c2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686441535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9be96d-146c-44b4-8ece-52203223f51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5e2adad3414d39a9bf9077bcdbdc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:00Z,use_quota=True,user_id='34795d495e464c22af52d88f33dc7265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dff87d-23e9-4f89-a09e-df7f25e6b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:00 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dff87d-23e9-4f89-a09e-df7f25e6b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:00 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:08:00 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86b1269-699a-4c8f-81f9-22a293bc6374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86b1269-699a-4c8f-81f9-22a293bc6374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9be96d-146c-44b4-8ece-52203223f51f', 'volume_name': 'volume-dc9be96d-146c-44b4-8ece-52203223f51f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a579320-3874-4684-a1fd-0277ac7367fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a579320-3874-4684-a1fd-0277ac7367fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db98714-8fd7-438c-8bd5-373f2afc8693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:00 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Volume dc9be96d-146c-44b4-8ece-52203223f51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9be96d-146c-44b4-8ece-52203223f51f', 'volume_size': 1} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:00 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.292s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Deleted volume successfully. Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e1ea1fb-be1f-417b-b17c-103bb643534c tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-ab777ea5-a119-40ed-9263-8426ca0b395f-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:00 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.447s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 Aug 25 07:08:00 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:08:00 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395" returned: 0 in 0.521s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e562610-165b-48e7-b18b-d6896f909e8a_ui5l4ssndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:08:00 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:08:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:00 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:00 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:00 devstack sudo[114279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1G Aug 25 07:08:00 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:01 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.303s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-a7192af1-3ec3-4c59-bb08-074637158679-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-a7192af1-3ec3-4c59-bb08-074637158679-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-quobyte-a7192af1-3ec3-4c59-bb08-074637158679" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-a7192af1-3ec3-4c59-bb08-074637158679" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:01 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 1G" returned: 0 in 0.504s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Downloaded image 0e562610-165b-48e7-b18b-d6896f909e8a ((None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}])) to volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Temporary image 0e562610-165b-48e7-b18b-d6896f909e8a for user e1809401a72c4637bb05fbfd9391dff6 is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Marking volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0104d51b-a5a5-4345-bbf2-ea25539568c6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Copying metadata from image 0e562610-165b-48e7-b18b-d6896f909e8a to 70536ecb-248e-4fab-bbc0-ba82ef9fe395. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Creating volume glance metadata for volume 70536ecb-248e-4fab-bbc0-ba82ef9fe395 backed by image 0e562610-165b-48e7-b18b-d6896f909e8a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e15c575dffa75813bd09adeada4f61d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac12d04-52fc-4460-9bab-4146c71c04f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395', 'volume_size': 1, 'image_id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e562610-165b-48e7-b18b-d6896f909e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e15c575dffa75813bd09adeada4f61d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09d6981092bb4d0ba5e0b56cb8da45f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4c4a8ae9ee6e244abe993cd0b52c891a4611e0ec614fa10dc78b7884e4aefb1e649b632be3fc1dbaf0d5c1985480e16f685b66927376efd6f8a341441044767', 'id': '0e562610-165b-48e7-b18b-d6896f909e8a', 'created_at': datetime.datetime(2026, 8, 25, 5, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e562610-165b-48e7-b18b-d6896f909e8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:01 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 Aug 25 07:08:01 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dcebee-b99b-48aa-b07c-f6b9054c8e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:01 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Volume volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 (70536ecb-248e-4fab-bbc0-ba82ef9fe395): created successfully Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dcebee-b99b-48aa-b07c-f6b9054c8e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Flow 'volume_create_manager' (7403207c-504e-4681-9fe5-b50c7162515f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-49ef8448-ff91-4718-a86b-a0e005c14013 tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Created volume successfully. Aug 25 07:08:02 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679" returned: 0 in 0.987s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:02 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679 Aug 25 07:08:02 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:02 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-a7192af1-3ec3-4c59-bb08-074637158679" returned: 0 in 0.579s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-a7192af1-3ec3-4c59-bb08-074637158679" released by "delete_volume" :: held 1.709s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Acquiring lock "cinder-70536ecb-248e-4fab-bbc0-ba82ef9fe395-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Created reservations ['8a299bff-5cbe-4b4e-8ad1-d79106b7e994', 'f5901f48-56ec-407b-b0d4-db9ee0ca072d', '023c40cc-7b29-4744-b1a8-04d0b55829c5', '13c1ca6d-7f4c-4d43-bf59-379845d50d7a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "cinder-70536ecb-248e-4fab-bbc0-ba82ef9fe395-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Acquiring lock "cinder-quobyte-70536ecb-248e-4fab-bbc0-ba82ef9fe395" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "cinder-quobyte-70536ecb-248e-4fab-bbc0-ba82ef9fe395" acquired by "delete_volume" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54d549-f70b-434d-bc53-b71efb2f4237]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:03 devstack sudo[114307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:03 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:03 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 Aug 25 07:08:03 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "cinder-quobyte-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" acquired by "delete_volume" :: waited 0.053s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493a913-3614-4bfa-b63d-42bcfab4369c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:04 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:04 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.792s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:04 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Deleted volume successfully. Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a933461-e087-4295-b27b-270eee951b43 tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-a7192af1-3ec3-4c59-bb08-074637158679-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:04 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395" returned: 0 in 1.047s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:04 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395 Aug 25 07:08:04 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:05 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" returned: 0 in 1.163s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:05 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-70536ecb-248e-4fab-bbc0-ba82ef9fe395" returned: 0 in 0.762s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "cinder-quobyte-70536ecb-248e-4fab-bbc0-ba82ef9fe395" released by "delete_volume" :: held 1.967s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:05 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf Aug 25 07:08:05 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Created reservations ['eaa7cbeb-b6f4-4fa0-a299-2e8857c9b4fc', '79b56425-c0d2-4a57-b86b-018c69367230', 'a53f50e4-1e59-425c-b9db-37b66286611b', '97e94fa5-cab3-4194-b719-c87e66c23f39'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:05 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:05 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:06 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" returned: 0 in 0.694s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-quobyte-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf" released by "delete_volume" :: held 2.025s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Created reservations ['7c14432e-f5fe-468d-84f8-eb8960720d0a', '72af3f13-29c3-4287-970c-7f1016f10fd3', 'dc66c796-fafb-49cb-b1d1-3e633b5273f0', '8bf0fbf8-0d93-4000-af78-a6d9d266089c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:06 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.590s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Deleted volume successfully. Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-689e442f-61c1-43d5-b072-91ed6fbbba7d tempest-VolumeAndVolumeTypeFromImageTest-1726129229 None] Lock "cinder-70536ecb-248e-4fab-bbc0-ba82ef9fe395-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:06 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:06 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:06 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271" returned: 0 in 6.261s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:08:06 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Converted 1024.00 MB image at 163.48 MB/s Aug 25 07:08:06 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 is being set with open permissions: ugo+rw Aug 25 07:08:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:06 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 Aug 25 07:08:06 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:07 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.468s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Deleted volume successfully. Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d9e71731-e20e-41bc-b85f-4c426e5a4f3f tempest-CreateVolumesFromImageTest-1460687650 None] Lock "cinder-0e5d10a9-fecb-4fdd-a49f-eaa533e4c8bf-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:07 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" released by "_copy_volume_from_snapshot" :: held 7.643s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-4f4fe59e-bcce-4161-a71d-9843ffbd8271" released by "_create_volume_from_snapshot" :: held 7.708s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.731s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.860s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686441535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9be96d-146c-44b4-8ece-52203223f51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5e2adad3414d39a9bf9077bcdbdc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:00Z,use_quota=True,user_id='34795d495e464c22af52d88f33dc7265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Creating volume dc9be96d-146c-44b4-8ece-52203223f51f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:07 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:07 devstack sudo[114335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f 1073741824 Aug 25 07:08:07 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95140bae-2f36-40c6-9eec-2011df0f171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271', 'volume_size': 1, 'snapshot_id': '349a21d5-c4b3-4401-be8b-57aaa6e0d11e'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51651edb-065d-4e3f-a7c0-7e4dc76e1a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Volume volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 (4f4fe59e-bcce-4161-a71d-9843ffbd8271): created successfully Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51651edb-065d-4e3f-a7c0-7e4dc76e1a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Flow 'volume_create_manager' (98074913-2104-44e1-a519-83705c918fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b2306ef3-0c55-4980-b212-970327767a4b tempest-VolumeDependencyTests-1926714975 None] Created volume successfully. Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Deleting offline snapshot 349a21d5-c4b3-4401-be8b-57aaa6e0d11e of volume db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] snapshot_file for this snap is: volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f575e-c100-4cfd-970a-94232868910a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:07 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f 1073741824" returned: 0 in 0.540s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:07 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f Aug 25 07:08:07 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:07 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:08:07 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:08 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f" returned: 0 in 0.284s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db98714-8fd7-438c-8bd5-373f2afc8693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9be96d-146c-44b4-8ece-52203223f51f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0811266-d167-4f2a-83c4-af6e9d15b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Volume volume-dc9be96d-146c-44b4-8ece-52203223f51f (dc9be96d-146c-44b4-8ece-52203223f51f): created successfully Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0811266-d167-4f2a-83c4-af6e9d15b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Flow 'volume_create_manager' (0bdd2dce-3ffc-4c55-8291-69223d63c269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:08 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-87975615-0c8a-47e7-98d8-b12433572c43 tempest-ProjectReaderTests-413840060 None] Created volume successfully. Aug 25 07:08:08 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.487s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4bb88d-0066-45f0-892a-6deaec4abb17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0509d30a-8f22-4ef4-a09f-1defbf004597]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:08 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:08:08 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:08 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.625s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:08 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:08:08 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.480s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e Aug 25 07:08:09 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17.349a21d5-c4b3-4401-be8b-57aaa6e0d11e" returned: 0 in 0.310s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-349a21d5-c4b3-4401-be8b-57aaa6e0d11e" released by "_delete_snapshot" :: held 2.058s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" released by "delete_snapshot" :: held 2.100s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Acquiring lock "cinder-dc9be96d-146c-44b4-8ece-52203223f51f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "cinder-dc9be96d-146c-44b4-8ece-52203223f51f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Created reservations ['972a4367-b179-42cc-9d07-b5c13345b5dd', '2d42027a-49a6-46f3-969a-aee2805ffc68', 'cd5d7644-dcf3-4079-b497-3f979362d99d', '01b11d47-56c5-4469-bd16-cc057515c72e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Acquiring lock "cinder-quobyte-dc9be96d-146c-44b4-8ece-52203223f51f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "cinder-quobyte-dc9be96d-146c-44b4-8ece-52203223f51f" acquired by "delete_volume" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b7c9ce-ee20-45f4-934d-612e87676bcf]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Delete snapshot completed successfully. Aug 25 07:08:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-adaf7b74-2760-4cc5-bc8e-d615b922814b tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-349a21d5-c4b3-4401-be8b-57aaa6e0d11e-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:10 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f Aug 25 07:08:10 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:10 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f" returned: 0 in 0.432s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:10 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f Aug 25 07:08:10 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:10 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-dc9be96d-146c-44b4-8ece-52203223f51f" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "cinder-quobyte-dc9be96d-146c-44b4-8ece-52203223f51f" released by "delete_volume" :: held 0.779s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Created reservations ['484b558c-35e8-46f9-9da9-f1b4543e3eda', '1cee5e64-e0f6-4601-8500-f9ef6cf3493c', '20b7869b-a6b9-4b98-a41b-36d45f975936', '3d3b50dc-259a-44af-a8a5-a0264050d748'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-db4bb88d-0066-45f0-892a-6deaec4abb17-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-db4bb88d-0066-45f0-892a-6deaec4abb17-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:10 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:10 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f0fd70-eaec-4e0e-a832-ed5a60851d01]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:11 devstack sudo[114373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:08:11 devstack sudo[114373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:11 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.619s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Deleted volume successfully. Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b36d70e-2b0e-4019-9f04-2fe6d09f7009 tempest-ProjectReaderTests-413840060 None] Lock "cinder-dc9be96d-146c-44b4-8ece-52203223f51f-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:11 devstack sudo[114373]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.510s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:11 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17 Aug 25 07:08:11 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Flow 'volume_create_manager' (ec065e79-51c9-4447-872e-fe527fb5232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22634eb-120b-4ffb-8833-e03e44a2b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22634eb-120b-4ffb-8833-e03e44a2b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859095174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10eff59-f080-46bf-a38b-13326ea2f26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5e2adad3414d39a9bf9077bcdbdc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:12Z,use_quota=True,user_id='34795d495e464c22af52d88f33dc7265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e0ee3-04b2-4163-87e5-e43b41c66a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e0ee3-04b2-4163-87e5-e43b41c66a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1f246b-7561-4c61-ba78-31e6507ecea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1f246b-7561-4c61-ba78-31e6507ecea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10eff59-f080-46bf-a38b-13326ea2f26f', 'volume_name': 'volume-d10eff59-f080-46bf-a38b-13326ea2f26f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b6f537-4d9a-439c-bf97-9d74145e1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b6f537-4d9a-439c-bf97-9d74145e1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d343c089-5ce6-4a4c-84a8-0e824334e63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Volume d10eff59-f080-46bf-a38b-13326ea2f26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10eff59-f080-46bf-a38b-13326ea2f26f', 'volume_size': 1} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859095174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10eff59-f080-46bf-a38b-13326ea2f26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5e2adad3414d39a9bf9077bcdbdc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:12Z,use_quota=True,user_id='34795d495e464c22af52d88f33dc7265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Creating volume d10eff59-f080-46bf-a38b-13326ea2f26f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:11 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:11 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-db4bb88d-0066-45f0-892a-6deaec4abb17" returned: 0 in 0.397s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:11 devstack sudo[114382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f 1073741824 Aug 25 07:08:11 devstack sudo[114382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-db4bb88d-0066-45f0-892a-6deaec4abb17" released by "delete_volume" :: held 0.999s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Created reservations ['d6e2bfa6-cd4e-41e1-bc38-c997f963a1a0', 'f840e89a-e456-4d2b-a5b2-581d99998dbd', '0c75b2e9-37c7-438c-8691-884406586905', 'd4346ae4-dc8f-4350-a1a3-abdecf7d5a25'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:12 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:12 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:12 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.307s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:12 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Deleted volume successfully. Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9e6c0151-9164-49ba-a677-2f63739f2d7f tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-db4bb88d-0066-45f0-892a-6deaec4abb17-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:12 devstack sudo[114382]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f 1073741824" returned: 0 in 0.633s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:12 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f Aug 25 07:08:12 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (2a5a76bf-a4ed-4722-8522-98e1995608c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe4213-b1fc-462f-8309-9dcb1c093ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe4213-b1fc-462f-8309-9dcb1c093ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218743275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd0819-3f41-4ee1-9f5d-1189804b069d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:13Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25713223-acb8-4f14-a2a2-600ad1501c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25713223-acb8-4f14-a2a2-600ad1501c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100176ef-f969-4512-b59f-8ee52684ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100176ef-f969-4512-b59f-8ee52684ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bd0819-3f41-4ee1-9f5d-1189804b069d', 'volume_name': 'volume-10bd0819-3f41-4ee1-9f5d-1189804b069d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:12 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121e2b81-cd6f-4010-925f-1576045f0baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121e2b81-cd6f-4010-925f-1576045f0baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3cd607-4879-48eb-b57f-2f05a4be3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:12 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume 10bd0819-3f41-4ee1-9f5d-1189804b069d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bd0819-3f41-4ee1-9f5d-1189804b069d', 'volume_size': 1} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f" returned: 0 in 0.314s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218743275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd0819-3f41-4ee1-9f5d-1189804b069d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:13Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume 10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:12 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:12 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d343c089-5ce6-4a4c-84a8-0e824334e63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10eff59-f080-46bf-a38b-13326ea2f26f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:12 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d 1073741824 Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2fb7da-6402-4b59-b84a-97b4a33c8aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:13 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Volume volume-d10eff59-f080-46bf-a38b-13326ea2f26f (d10eff59-f080-46bf-a38b-13326ea2f26f): created successfully Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2fb7da-6402-4b59-b84a-97b4a33c8aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Flow 'volume_create_manager' (ec065e79-51c9-4447-872e-fe527fb5232e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:13 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f56fc22a-0dcd-4832-9dc9-a08f2d5a2d19 tempest-ProjectReaderTests-413840060 None] Created volume successfully. Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-4f4fe59e-bcce-4161-a71d-9843ffbd8271-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-4f4fe59e-bcce-4161-a71d-9843ffbd8271-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a4b681-d1a2-42bc-9b82-04579bfc45fc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:13 devstack sudo[114398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 Aug 25 07:08:13 devstack sudo[114398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d 1073741824" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:13 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d Aug 25 07:08:13 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack sudo[114398]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271" returned: 0 in 0.503s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Acquiring lock "cinder-d10eff59-f080-46bf-a38b-13326ea2f26f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack sudo[114405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271 Aug 25 07:08:13 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "cinder-d10eff59-f080-46bf-a38b-13326ea2f26f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:13 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d" returned: 0 in 0.361s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Acquiring lock "cinder-quobyte-d10eff59-f080-46bf-a38b-13326ea2f26f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3cd607-4879-48eb-b57f-2f05a4be3052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bd0819-3f41-4ee1-9f5d-1189804b069d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1d1515-0b1e-48f4-b51d-8c5205a3193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:13 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "cinder-quobyte-d10eff59-f080-46bf-a38b-13326ea2f26f" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-10bd0819-3f41-4ee1-9f5d-1189804b069d (10bd0819-3f41-4ee1-9f5d-1189804b069d): created successfully Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1d1515-0b1e-48f4-b51d-8c5205a3193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (2a5a76bf-a4ed-4722-8522-98e1995608c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364f070-b020-4e25-8229-ee8aefa7a3c0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c5113be6-566f-46c8-aa59-09822314d814 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:14 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-4f4fe59e-bcce-4161-a71d-9843ffbd8271" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-quobyte-4f4fe59e-bcce-4161-a71d-9843ffbd8271" released by "delete_volume" :: held 0.883s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:14 devstack sudo[114408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f Aug 25 07:08:14 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Created reservations ['257619f7-c442-4a86-a03f-f754b2986d2c', '104e8e11-3f93-4803-a368-d7f3728aabb9', '5ea84a5b-abb9-47bd-8127-4d215a6f2d90', '7c00ed6e-be0c-451a-875a-226e2eea5ce4'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:14 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f Aug 25 07:08:14 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.320s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:14 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Deleted volume successfully. Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f221ba97-39a4-42b5-9dd0-0eecff9b6213 tempest-VolumeDependencyTests-1926714975 None] Lock "cinder-4f4fe59e-bcce-4161-a71d-9843ffbd8271-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Flow 'volume_create_manager' (e3a133cd-7e4b-4dd0-be19-624c780e8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d455e3-8b89-4617-8958-3e6131a401a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d455e3-8b89-4617-8958-3e6131a401a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21799a4e-096a-4e91-b204-04441259a059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90eea664dd4405f95c831d9c211cd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:15Z,use_quota=True,user_id='dd21c9c08bcd42eb886a7ee4bfe12d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e309cba-aa13-4aac-830e-d6f8ab63bcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e309cba-aa13-4aac-830e-d6f8ab63bcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945130dd-64d5-43dc-907b-2f38cb680087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.image.glance [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Creating Keystone auth plugin from conf {{(pid=94487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:08:14 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d10eff59-f080-46bf-a38b-13326ea2f26f" returned: 0 in 0.323s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "cinder-quobyte-d10eff59-f080-46bf-a38b-13326ea2f26f" released by "delete_volume" :: held 0.841s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Created reservations ['6678d0a0-50af-4071-907e-f71834d6c7c5', '8d01d593-e601-4ed2-8a4c-68cfb55bba1a', '0b463569-cfdd-4b7e-90da-b783e7d4a664', '3827ba6d-5b6b-4d4e-bf39-d8f1c171b978'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:15 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating offline snapshot 06df343c-eaf1-4929-9e25-ecff9f879a8d of volume 10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b928d6a-6bcd-4ac5-bcd5-a82e45e40dc4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.361s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Deleted volume successfully. Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1147c906-fbbf-4ca1-a0ec-8a8aba3b4c18 tempest-ProjectReaderTests-413840060 None] Lock "cinder-d10eff59-f080-46bf-a38b-13326ea2f26f-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:15 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d Aug 25 07:08:15 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945130dd-64d5-43dc-907b-2f38cb680087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21799a4e-096a-4e91-b204-04441259a059', 'volume_name': 'volume-21799a4e-096a-4e91-b204-04441259a059', 'volume_size': 1, 'image_id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce05150226b2de8f084616d60c58f9f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e90eea664dd4405f95c831d9c211cd38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2f935afac3704fa0090e02358b32a08dc9576e5f84711b1284bc2a19549a826acb302f2bf9a278b160cab4426b512afb833d4ef293fb04b9f9a5fedbbe1f25', 'id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'created_at': datetime.datetime(2026, 8, 25, 5, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b19da2-fab7-46b4-bbec-6f74fdde9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b19da2-fab7-46b4-bbec-6f74fdde9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb07b21-7540-4e19-916d-553c11bad563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:15 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Volume 21799a4e-096a-4e91-b204-04441259a059: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21799a4e-096a-4e91-b204-04441259a059', 'volume_size': 1, 'image_id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce05150226b2de8f084616d60c58f9f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e90eea664dd4405f95c831d9c211cd38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2f935afac3704fa0090e02358b32a08dc9576e5f84711b1284bc2a19549a826acb302f2bf9a278b160cab4426b512afb833d4ef293fb04b9f9a5fedbbe1f25', 'id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'created_at': datetime.datetime(2026, 8, 25, 5, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1/file', 'properties': {}}, 'image_service': } Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Trying to clone 21799a4e-096a-4e91-b204-04441259a059 from image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}]). {{(pid=94487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:08:15 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68ecf2-72da-455e-84d3-04b49b6e71b6]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d" returned: 0 in 0.640s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d 1G Aug 25 07:08:15 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:16 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d 1G" returned: 0 in 0.572s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd0819-3f41-4ee1-9f5d-1189804b069d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:16 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[114439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd0819-3f41-4ee1-9f5d-1189804b069d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d Aug 25 07:08:16 devstack sudo[114439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 1 in 0.501s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Temporary image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 is fetched for user dd21c9c08bcd42eb886a7ee4bfe12d4b. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:08:16 devstack sudo[114439]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd0819-3f41-4ee1-9f5d-1189804b069d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d" returned: 0 in 0.413s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d is being set with open permissions: ugo+rw Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d Aug 25 07:08:16 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8781ab-2897-4269-9245-7b67640b427b]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:17 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info Aug 25 07:08:17 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:17 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info is being set with open permissions: ugo+rw Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info Aug 25 07:08:17 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:17 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.info" returned: 0 in 0.305s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21799a4e-096a-4e91-b204-04441259a059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90eea664dd4405f95c831d9c211cd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:15Z,use_quota=True,user_id='dd21c9c08bcd42eb886a7ee4bfe12d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Creating volume 21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:18 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:18 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1073741824 Aug 25 07:08:18 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f5c6f439-cdc9-4697-b855-3a7b560871e6 tempest-CreateVolumesFromSnapshotTest-110927016 None] Create snapshot completed successfully Aug 25 07:08:18 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1073741824" returned: 0 in 0.585s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:18 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 Aug 25 07:08:18 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:18 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059" returned: 0 in 0.301s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:18 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Attempting download of 9d2b260a-ee78-4ae9-ad16-1887565e37f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}])) to volume 21799a4e-096a-4e91-b204-04441259a059. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9dd8b-6d42-4d3a-951b-4ee8ece81c3c]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (594f7fde-4d6c-4c9a-9a2e-298bad682832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44b4dde-befa-44b8-b118-1af15ac3b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk Aug 25 07:08:19 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44b4dde-befa-44b8-b118-1af15ac3b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259317485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cfe184-8371-4f0b-a2b6-dbe95140223c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:19Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b658a8-5609-4566-8102-e5ddab040e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b658a8-5609-4566-8102-e5ddab040e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f7203d-772a-467d-b657-d98422bd275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f7203d-772a-467d-b657-d98422bd275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cfe184-8371-4f0b-a2b6-dbe95140223c', 'volume_name': 'volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e11c009-cef4-44f5-b657-afb2f4e0d4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e11c009-cef4-44f5-b657-afb2f4e0d4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2215e5-7b6c-42c0-9bd4-69fda27c6657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume c9cfe184-8371-4f0b-a2b6-dbe95140223c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c', 'volume_size': 1} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259317485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cfe184-8371-4f0b-a2b6-dbe95140223c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:19Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume c9cfe184-8371-4f0b-a2b6-dbe95140223c {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:19 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:19 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c 1073741824 Aug 25 07:08:19 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Flow 'volume_create_manager' (1bb30adc-c59c-4f1e-93a3-f59a752d9987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c9b67-c1d3-454e-bdf8-7df329405cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c9b67-c1d3-454e-bdf8-7df329405cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd838bd4dd2474cafd6f358b3c942f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:19Z,use_quota=True,user_id='f0e6f83471c7471bbca7da4d4b21b868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24b1db4-8dc6-4f8a-8cf2-5c730870011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24b1db4-8dc6-4f8a-8cf2-5c730870011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcc7bf6-fbb9-490c-b97d-efe27ae8fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcc7bf6-fbb9-490c-b97d-efe27ae8fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9', 'volume_name': 'volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09cb159-0135-401a-ab0c-69903224ee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09cb159-0135-401a-ab0c-69903224ee8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2f9153-3984-4d3c-9e0d-92c1f1061396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Volume f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9', 'volume_size': 1} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:19 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:19 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk Aug 25 07:08:19 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (d42fa4bc-baf1-4ea5-8831-21cae738060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92842772-9da9-472a-894e-200d67a402ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92842772-9da9-472a-894e-200d67a402ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-575296011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070ae9f8-dc16-4e87-872c-c062c7f239ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:20Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64194f6-641d-462c-b726-8738d6a206df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64194f6-641d-462c-b726-8738d6a206df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5bdc8-1a7a-4e01-9d23-c32bacad1b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5bdc8-1a7a-4e01-9d23-c32bacad1b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070ae9f8-dc16-4e87-872c-c062c7f239ff', 'volume_name': 'volume-070ae9f8-dc16-4e87-872c-c062c7f239ff', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e032115-4ccd-4a2b-ab17-f332b090209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e032115-4ccd-4a2b-ab17-f332b090209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa15c34-7df5-4591-a9d4-6d6864daf4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:19 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume 070ae9f8-dc16-4e87-872c-c062c7f239ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070ae9f8-dc16-4e87-872c-c062c7f239ff', 'volume_size': 1} Aug 25 07:08:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:20 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c 1073741824" returned: 0 in 0.699s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:20 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:20 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c Aug 25 07:08:20 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk" returned: 1 in 0.618s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d2b260a-ee78-4ae9-ad16-1887565e37f1_4blmd0yk' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bc74e2-1365-4e05-b4af-d923a9148377]: (4, 'raw') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (e73fe0bf-8ce0-4b98-9fcc-01404ed6d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba457c-ae49-409a-a806-fb5226c05909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba457c-ae49-409a-a806-fb5226c05909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079476152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10689796-f1c8-4a6e-933f-239bfe0fea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:20Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:20 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fb69fa-40ea-4fa4-8f17-b15469608136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fb69fa-40ea-4fa4-8f17-b15469608136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc513332-9203-40dc-a3fb-a153c3e4259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc513332-9203-40dc-a3fb-a153c3e4259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10689796-f1c8-4a6e-933f-239bfe0fea87', 'volume_name': 'volume-10689796-f1c8-4a6e-933f-239bfe0fea87', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d310747-c506-4c00-9af1-e7a4f80c88c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d310747-c506-4c00-9af1-e7a4f80c88c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e56c554-3ce5-4384-a700-e4d401f5b731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume 10689796-f1c8-4a6e-933f-239bfe0fea87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10689796-f1c8-4a6e-933f-239bfe0fea87', 'volume_size': 1} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:20 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c" returned: 0 in 0.331s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd838bd4dd2474cafd6f358b3c942f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:19Z,use_quota=True,user_id='f0e6f83471c7471bbca7da4d4b21b868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Creating volume f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:20 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2215e5-7b6c-42c0-9bd4-69fda27c6657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 1073741824 Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51037e24-fd59-4afe-ac38-c3866391908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c (c9cfe184-8371-4f0b-a2b6-dbe95140223c): created successfully Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51037e24-fd59-4afe-ac38-c3866391908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (594f7fde-4d6c-4c9a-9a2e-298bad682832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-2c5806eb-e1df-4840-9595-e4de06fb9228 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:20 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (bf9ef94b-9f08-4be6-820c-6b3e1d7dfc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e44305-3f8b-482a-8a24-ba3f6909fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD Aug 25 07:08:20 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e44305-3f8b-482a-8a24-ba3f6909fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309555422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0471c4f4-026d-4c9d-92c5-830af1b6cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0471c4f4-026d-4c9d-92c5-830af1b6cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d5ec7-afd4-4f56-81ed-d5d88146d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d5ec7-afd4-4f56-81ed-d5d88146d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca', 'volume_name': 'volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e39b33-a2d0-4d51-bd91-c16e713a28a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e39b33-a2d0-4d51-bd91-c16e713a28a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b708ef5-7e6d-4eae-8463-c84b654e09ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca', 'volume_size': 1} Aug 25 07:08:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:21 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 1073741824" returned: 0 in 0.655s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:21 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 Aug 25 07:08:21 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:21 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD" returned: 1 in 0.581s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] 9d2b260a-ee78-4ae9-ad16-1887565e37f1 was raw, converting to qcow2 {{(pid=94487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:21 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 Aug 25 07:08:21 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (8defa824-f53e-49a6-947a-ee60a8c5d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d612095-d742-4878-a187-dd01ec41a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d612095-d742-4878-a187-dd01ec41a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268456363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c83aea-6fb5-46c6-9195-3841e3c7a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b25338-7725-434d-b419-6116ce0d3701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b25338-7725-434d-b419-6116ce0d3701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd12cf8-3ad1-403c-87d3-6574755f422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd12cf8-3ad1-403c-87d3-6574755f422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c83aea-6fb5-46c6-9195-3841e3c7a85a', 'volume_name': 'volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a01f4a-00ac-4462-b077-e1ba629ad028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a01f4a-00ac-4462-b077-e1ba629ad028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6ee5e8-4a55-48e8-8a9e-708d994548ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume 37c83aea-6fb5-46c6-9195-3841e3c7a85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a', 'volume_size': 1} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-575296011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070ae9f8-dc16-4e87-872c-c062c7f239ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:20Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume 070ae9f8-dc16-4e87-872c-c062c7f239ff {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:21 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2f9153-3984-4d3c-9e0d-92c1f1061396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a610814e-011a-4917-be15-51c1514c30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff 1073741824 Aug 25 07:08:21 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Volume volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 (f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9): created successfully Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a610814e-011a-4917-be15-51c1514c30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Flow 'volume_create_manager' (1bb30adc-c59c-4f1e-93a3-f59a752d9987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-65d570f6-022f-48c9-b7b8-3c366baffdfd tempest-CinderUnicodeTest-132799817 None] Created volume successfully. Aug 25 07:08:21 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059" returned: 0 in 0.604s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d2b260a-ee78-4ae9-ad16-1887565e37f1_bh3viehxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:08:21 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:08:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:21 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1G Aug 25 07:08:21 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff 1073741824" returned: 0 in 0.514s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff Aug 25 07:08:22 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 1G" returned: 0 in 0.343s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Downloaded image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}])) to volume 21799a4e-096a-4e91-b204-04441259a059 successfully. {{(pid=94487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Temporary image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 for user dd21c9c08bcd42eb886a7ee4bfe12d4b is deleted. {{(pid=94487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.volume_utils [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Marking volume 21799a4e-096a-4e91-b204-04441259a059 as bootable. {{(pid=94487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Copying metadata from image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 to 21799a4e-096a-4e91-b204-04441259a059. {{(pid=94487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Creating volume glance metadata for volume 21799a4e-096a-4e91-b204-04441259a059 backed by image 9d2b260a-ee78-4ae9-ad16-1887565e37f1 with: {'image_id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ce05150226b2de8f084616d60c58f9f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb07b21-7540-4e19-916d-553c11bad563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21799a4e-096a-4e91-b204-04441259a059', 'volume_size': 1, 'image_id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce05150226b2de8f084616d60c58f9f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e90eea664dd4405f95c831d9c211cd38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2f935afac3704fa0090e02358b32a08dc9576e5f84711b1284bc2a19549a826acb302f2bf9a278b160cab4426b512afb833d4ef293fb04b9f9a5fedbbe1f25', 'id': '9d2b260a-ee78-4ae9-ad16-1887565e37f1', 'created_at': datetime.datetime(2026, 8, 25, 5, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d2b260a-ee78-4ae9-ad16-1887565e37f1/file', 'properties': {}}, 'image_service': }' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f3b88-8d4a-4070-811b-c1d6a604e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:22 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Volume volume-21799a4e-096a-4e91-b204-04441259a059 (21799a4e-096a-4e91-b204-04441259a059): created successfully Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f3b88-8d4a-4070-811b-c1d6a604e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Flow 'volume_create_manager' (e3a133cd-7e4b-4dd0-be19-624c780e8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-817de482-03b3-40e9-a6e7-83ed6c9f4bb2 tempest-VolumeImageDependencyTests-227224175 None] Created volume successfully. Aug 25 07:08:22 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff" returned: 0 in 0.296s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079476152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10689796-f1c8-4a6e-933f-239bfe0fea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:20Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume 10689796-f1c8-4a6e-933f-239bfe0fea87 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:22 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa15c34-7df5-4591-a9d4-6d6864daf4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070ae9f8-dc16-4e87-872c-c062c7f239ff', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:22 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 1073741824 Aug 25 07:08:22 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ea8f38-d433-4359-aac4-47254ce3a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:22 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-070ae9f8-dc16-4e87-872c-c062c7f239ff (070ae9f8-dc16-4e87-872c-c062c7f239ff): created successfully Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ea8f38-d433-4359-aac4-47254ce3a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (d42fa4bc-baf1-4ea5-8831-21cae738060f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3e712a84-f68b-46c3-8975-6beefd1aee27 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Acquiring lock "cinder-21799a4e-096a-4e91-b204-04441259a059-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "cinder-21799a4e-096a-4e91-b204-04441259a059-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Acquiring lock "cinder-quobyte-21799a4e-096a-4e91-b204-04441259a059" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "cinder-quobyte-21799a4e-096a-4e91-b204-04441259a059" acquired by "delete_volume" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47fa002-5ed6-4c5e-8aa9-9ca48c1e87ac]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 Aug 25 07:08:23 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 1073741824" returned: 0 in 0.701s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 Aug 25 07:08:23 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Flow 'volume_create_manager' (668b34fd-83b6-4726-a3f3-6cfcb3c06323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51306478-2bd5-43a0-bf66-05fa6ec10288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51306478-2bd5-43a0-bf66-05fa6ec10288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-70336460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96f3184-5b41-4900-8846-18fd895473ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd838bd4dd2474cafd6f358b3c942f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:23Z,use_quota=True,user_id='f0e6f83471c7471bbca7da4d4b21b868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4241591-388b-48ba-95a2-cf3d8a8ea828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4241591-388b-48ba-95a2-cf3d8a8ea828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c79531-ce04-424e-9432-417332370032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c79531-ce04-424e-9432-417332370032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96f3184-5b41-4900-8846-18fd895473ab', 'volume_name': 'volume-c96f3184-5b41-4900-8846-18fd895473ab', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ed4bcf-be8e-46c6-8f57-11220cc3db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ed4bcf-be8e-46c6-8f57-11220cc3db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b61c91-0976-4d9d-912b-a044e284c2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Volume c96f3184-5b41-4900-8846-18fd895473ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96f3184-5b41-4900-8846-18fd895473ab', 'volume_size': 1} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:23 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059" returned: 0 in 0.509s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059 Aug 25 07:08:23 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87" returned: 0 in 0.362s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.579s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309555422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:23 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca 1073741824 Aug 25 07:08:23 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e56c554-3ce5-4384-a700-e4d401f5b731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10689796-f1c8-4a6e-933f-239bfe0fea87', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5c5f7-8e61-44d8-bf95-00246016b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-10689796-f1c8-4a6e-933f-239bfe0fea87 (10689796-f1c8-4a6e-933f-239bfe0fea87): created successfully Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5c5f7-8e61-44d8-bf95-00246016b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (e73fe0bf-8ce0-4b98-9fcc-01404ed6d18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e92acb75-5c1f-41e2-be55-18e8cbc3f193 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:23 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-21799a4e-096a-4e91-b204-04441259a059" returned: 0 in 0.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "cinder-quobyte-21799a4e-096a-4e91-b204-04441259a059" released by "delete_volume" :: held 0.920s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Created reservations ['5c8eccab-21d6-400d-b9e4-4ff62216888a', '612a95f6-5b90-43e4-a2dc-d47d09216818', 'd298d289-fb6d-4d9e-aeb8-f9650f41f822', '9a0c7141-2af7-4569-b7fa-78b7b37fbae0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:24 devstack sudo[114555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:24 devstack sudo[114555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:24 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca 1073741824" returned: 0 in 0.566s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:24 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca Aug 25 07:08:24 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:24 devstack sudo[114555]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.417s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Deleted volume successfully. Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-e4bb1f2f-d94f-4092-9a97-85f6714782b4 tempest-VolumeImageDependencyTests-227224175 None] Lock "cinder-21799a4e-096a-4e91-b204-04441259a059-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:24 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" returned: 0 in 0.293s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268456363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c83aea-6fb5-46c6-9195-3841e3c7a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a3db7f8184e359068253e0260f02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='5908ba6f3fa74cb29363092564afb2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Creating volume 37c83aea-6fb5-46c6-9195-3841e3c7a85a {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:24 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b708ef5-7e6d-4eae-8463-c84b654e09ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78aedf20-6ed5-422d-a077-de67553a9191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a 1073741824 Aug 25 07:08:24 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:24 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca (d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca): created successfully Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78aedf20-6ed5-422d-a077-de67553a9191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (bf9ef94b-9f08-4be6-820c-6b3e1d7dfc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cd62b6bf-a612-4c25-90b8-ea1423fbc0c2 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:25 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a 1073741824" returned: 0 in 0.589s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:25 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a Aug 25 07:08:25 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:25 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a" returned: 0 in 0.310s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-70336460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96f3184-5b41-4900-8846-18fd895473ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd838bd4dd2474cafd6f358b3c942f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:23Z,use_quota=True,user_id='f0e6f83471c7471bbca7da4d4b21b868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Creating volume c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:25 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6ee5e8-4a55-48e8-8a9e-708d994548ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:25 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab 1073741824 Aug 25 07:08:25 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e472bd-1d43-4636-80da-236ce5089d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:25 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Volume volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a (37c83aea-6fb5-46c6-9195-3841e3c7a85a): created successfully Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e472bd-1d43-4636-80da-236ce5089d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:25 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Flow 'volume_create_manager' (8defa824-f53e-49a6-947a-ee60a8c5d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c7907a3d-41a1-41b9-8c18-046036a7d168 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created volume successfully. Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-37c83aea-6fb5-46c6-9195-3841e3c7a85a-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-37c83aea-6fb5-46c6-9195-3841e3c7a85a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-37c83aea-6fb5-46c6-9195-3841e3c7a85a" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:26 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab 1073741824" returned: 0 in 0.669s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-37c83aea-6fb5-46c6-9195-3841e3c7a85a" acquired by "delete_volume" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cddcfbf-533d-484c-8724-f3741bc84c83]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:26 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab Aug 25 07:08:26 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:26 devstack sudo[114576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a Aug 25 07:08:26 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:26 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b61c91-0976-4d9d-912b-a044e284c2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96f3184-5b41-4900-8846-18fd895473ab', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72789233-1a9f-40c7-837f-cc41c4a8f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:26 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Volume volume-c96f3184-5b41-4900-8846-18fd895473ab (c96f3184-5b41-4900-8846-18fd895473ab): created successfully Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72789233-1a9f-40c7-837f-cc41c4a8f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Flow 'volume_create_manager' (668b34fd-83b6-4726-a3f3-6cfcb3c06323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:26 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8f578060-73fe-40e4-a7cb-5b9be912569d tempest-CinderUnicodeTest-132799817 None] Created volume successfully. Aug 25 07:08:26 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a" returned: 0 in 0.535s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:26 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a Aug 25 07:08:26 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:27 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-37c83aea-6fb5-46c6-9195-3841e3c7a85a" returned: 0 in 0.307s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-37c83aea-6fb5-46c6-9195-3841e3c7a85a" released by "delete_volume" :: held 0.903s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['9d4131cc-d186-48e5-89b4-24e837e5c558', '966ba0c8-a8a7-44b2-87e7-a7550d04534b', '5e0c6cbe-746b-4a6e-9149-483643e88f5f', '1b33add2-1898-4bbd-af29-a11e6ed72baf'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:27 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:27 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:27 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.286s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-370b3223-4bb2-4b08-b761-bf4ee1535400 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-37c83aea-6fb5-46c6-9195-3841e3c7a85a-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Creating offline snapshot a3ed887e-d369-4c80-a492-a993a2eff9db of volume c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d462537-aed9-4c38-b2c6-f1209a0c6d6c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:28 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab Aug 25 07:08:28 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:28 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab" returned: 0 in 0.471s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f536d-c252-4a32-9062-a858c50b32c2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:28 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db 1G Aug 25 07:08:28 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:28 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca Aug 25 07:08:28 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:28 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:29 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca Aug 25 07:08:29 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db 1G" returned: 0 in 0.591s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96f3184-5b41-4900-8846-18fd895473ab -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:29 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96f3184-5b41-4900-8846-18fd895473ab -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db Aug 25 07:08:29 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca" released by "delete_volume" :: held 0.916s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['10611b85-dd4f-48b1-8c1f-9ab9dbb9f499', '424f3cb3-b32e-4902-89f5-4257dce44ea5', '5c143a8c-86bc-4644-8c2e-7aa5b196a51a', 'e5bc966c-e3ff-4a4c-970a-8ed0e4a52678'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:29 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96f3184-5b41-4900-8846-18fd895473ab -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db" returned: 0 in 0.613s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:29 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db is being set with open permissions: ugo+rw Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:29 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db Aug 25 07:08:29 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (4f04982c-4fb9-44ed-8190-d41166b15d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6774b-cc54-4454-99c3-2d651f7f3283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6774b-cc54-4454-99c3-2d651f7f3283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305299756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f316c408-0248-4460-aa40-9afea9ea6a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:30Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624641a-1ea2-40e4-a41d-98b29934936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:29 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624641a-1ea2-40e4-a41d-98b29934936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66d6f62-55dd-4876-9a61-a756cbad21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66d6f62-55dd-4876-9a61-a756cbad21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f316c408-0248-4460-aa40-9afea9ea6a0d', 'volume_name': 'volume-f316c408-0248-4460-aa40-9afea9ea6a0d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24c9146-e484-4a8c-8535-98c6765db1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24c9146-e484-4a8c-8535-98c6765db1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db5ea20-be4f-46ec-b20f-6ae841060063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Volume f316c408-0248-4460-aa40-9afea9ea6a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f316c408-0248-4460-aa40-9afea9ea6a0d', 'volume_size': 1} Aug 25 07:08:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:30 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db" returned: 0 in 0.315s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info Aug 25 07:08:30 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:30 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d77c2ae1-61b9-4112-9928-f1d56955d599 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-d75aeb3f-3c2b-4ace-8e40-ce9a0b1feaca-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:30 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info is being set with open permissions: ugo+rw Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info Aug 25 07:08:30 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:30 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.info" returned: 0 in 0.254s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305299756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f316c408-0248-4460-aa40-9afea9ea6a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:30Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Creating volume f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:30 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d 1073741824 Aug 25 07:08:30 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7ccbac25-155c-413a-81bb-5f2f4034d413 tempest-CinderUnicodeTest-132799817 None] Create snapshot completed successfully Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-10689796-f1c8-4a6e-933f-239bfe0fea87-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-10689796-f1c8-4a6e-933f-239bfe0fea87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-10689796-f1c8-4a6e-933f-239bfe0fea87" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10689796-f1c8-4a6e-933f-239bfe0fea87" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[80390184-0f2b-4134-8c0f-5b6fb671a05a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[114632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 Aug 25 07:08:30 devstack sudo[114632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-a3ed887e-d369-4c80-a492-a993a2eff9db-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-a3ed887e-d369-4c80-a492-a993a2eff9db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:31 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d 1073741824" returned: 0 in 0.570s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-quobyte-a3ed887e-d369-4c80-a492-a993a2eff9db" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-a3ed887e-d369-4c80-a492-a993a2eff9db" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Deleting offline snapshot a3ed887e-d369-4c80-a492-a993a2eff9db of volume c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] snapshot_file for this snap is: volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:31 devstack sudo[114632]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87" returned: 0 in 0.492s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c0288e-613a-49f1-90c4-5d032c8730c9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:31 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[114642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87 Aug 25 07:08:31 devstack sudo[114642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db Aug 25 07:08:31 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d" returned: 0 in 0.320s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db5ea20-be4f-46ec-b20f-6ae841060063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f316c408-0248-4460-aa40-9afea9ea6a0d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:31 devstack sudo[114642]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b50d0f0-45b4-4229-a1cf-9a3069bc15bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10689796-f1c8-4a6e-933f-239bfe0fea87" returned: 0 in 0.370s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10689796-f1c8-4a6e-933f-239bfe0fea87" released by "delete_volume" :: held 0.914s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:31 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Volume volume-f316c408-0248-4460-aa40-9afea9ea6a0d (f316c408-0248-4460-aa40-9afea9ea6a0d): created successfully Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b50d0f0-45b4-4229-a1cf-9a3069bc15bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (4f04982c-4fb9-44ed-8190-d41166b15d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-bd75dfc4-9aa8-4680-8517-0cc003046009 tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:08:31 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db" returned: 0 in 0.456s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c96f3184-5b41-4900-8846-18fd895473ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['1d53db06-fc5c-4f7f-a77c-14501d8e82f6', '025139d8-a6e7-4e2c-b12c-a8a739380a24', '88de8c7e-b153-43f9-a3a7-3e2252c5275c', '522d522f-9d42-4d13-b20c-8d1907a972a3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88db7f-a10a-45d7-8cbc-b00b22ad1d0c]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:31 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab Aug 25 07:08:31 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.266s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-04b4d2b1-4f15-4686-87b3-585aae40d8a0 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-10689796-f1c8-4a6e-933f-239bfe0fea87-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:32 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:32 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db Aug 25 07:08:32 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:32 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db Aug 25 07:08:32 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab.a3ed887e-d369-4c80-a492-a993a2eff9db" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-a3ed887e-d369-4c80-a492-a993a2eff9db" released by "_delete_snapshot" :: held 1.707s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-070ae9f8-dc16-4e87-872c-c062c7f239ff-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" released by "delete_snapshot" :: held 1.749s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-070ae9f8-dc16-4e87-872c-c062c7f239ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-070ae9f8-dc16-4e87-872c-c062c7f239ff" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-070ae9f8-dc16-4e87-872c-c062c7f239ff" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Created reservations ['f4532d6b-1905-4528-9c29-b0c925e2483d', 'da7060f5-b24f-45ff-9722-d814767b83bf', 'a2992d99-6d69-41ce-848d-eb40a09715c9', '4d87ee66-f690-4392-9560-119dfd9ebf50'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d0e0f-f96f-4eb7-9dc1-c6c6b75ae366]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Delete snapshot completed successfully. Aug 25 07:08:33 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff Aug 25 07:08:33 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-67f76058-5f9f-4e1b-935a-19fedce28ad6 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-a3ed887e-d369-4c80-a492-a993a2eff9db-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-c96f3184-5b41-4900-8846-18fd895473ab-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "cinder-c96f3184-5b41-4900-8846-18fd895473ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot dc7a3f10-607a-4953-b15e-002979e4de82 of volume f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea9d1d2-a3c7-463a-890a-6c1779ca4cfe]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcc9ef7-2747-4b31-938f-9c94f4dfd23b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff" returned: 0 in 0.467s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d Aug 25 07:08:33 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[114676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff Aug 25 07:08:33 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab Aug 25 07:08:33 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-070ae9f8-dc16-4e87-872c-c062c7f239ff" returned: 0 in 0.320s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d" returned: 0 in 0.457s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-070ae9f8-dc16-4e87-872c-c062c7f239ff" released by "delete_volume" :: held 0.859s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 1G Aug 25 07:08:33 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab" returned: 0 in 0.445s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['9c674119-d03f-4cc2-a7e7-9183f1086dd7', '47224c7f-2827-4e7a-b1ae-81911c03c380', '60694d18-f3d2-4e57-924e-76af12800efd', '6f345e25-68e3-4b4c-bfbb-0cdb9ba3ec2b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:34 devstack sudo[114690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab Aug 25 07:08:34 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:34 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-c9cfe184-8371-4f0b-a2b6-dbe95140223c-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-c9cfe184-8371-4f0b-a2b6-dbe95140223c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-c9cfe184-8371-4f0b-a2b6-dbe95140223c" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-c9cfe184-8371-4f0b-a2b6-dbe95140223c" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:34 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c96f3184-5b41-4900-8846-18fd895473ab" returned: 0 in 0.373s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba37934-39c3-4832-8e53-267d55261bf9]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-c96f3184-5b41-4900-8846-18fd895473ab" released by "delete_volume" :: held 0.916s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Created reservations ['ccd92271-761e-499b-aa24-fd411d0cf8b1', 'b9fca93d-94ef-421b-b823-baa364bdd55d', '21997f39-00e8-4be8-b649-404ceedb7e45', 'c36768a7-3c7c-4909-80e2-f8556c4a6dc1'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:34 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:34 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack sudo[114698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.483s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack sudo[114698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 1G" returned: 0 in 0.703s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f316c408-0248-4460-aa40-9afea9ea6a0d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:34 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:34 devstack sudo[114704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f316c408-0248-4460-aa40-9afea9ea6a0d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 Aug 25 07:08:34 devstack sudo[114704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-cd2cbe49-9481-4a21-9c61-64c22af3d406 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-070ae9f8-dc16-4e87-872c-c062c7f239ff-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:34 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.340s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:35 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Deleted volume successfully. Aug 25 07:08:35 devstack sudo[114698]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c" returned: 0 in 0.577s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-14431bcf-9afa-448b-b3b4-9a45896644df tempest-CinderUnicodeTest-132799817 None] Lock "cinder-c96f3184-5b41-4900-8846-18fd895473ab-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:35 devstack sudo[114704]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f316c408-0248-4460-aa40-9afea9ea6a0d -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:35 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 is being set with open permissions: ugo+rw Aug 25 07:08:35 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c Aug 25 07:08:35 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 Aug 25 07:08:35 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c9cfe184-8371-4f0b-a2b6-dbe95140223c" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-c9cfe184-8371-4f0b-a2b6-dbe95140223c" released by "delete_volume" :: held 0.907s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:35 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['342948a0-498d-4223-8f13-eb1747de6809', '4992baa6-ea3c-4602-bc32-42fc60def17a', '6ed0ed96-cf84-403d-8977-bed4a8494c5f', '79e8acf9-1f9e-4ac6-a28c-a42907b30782'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:35 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info Aug 25 07:08:35 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:35 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-06df343c-eaf1-4929-9e25-ecff9f879a8d-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-06df343c-eaf1-4929-9e25-ecff9f879a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-06df343c-eaf1-4929-9e25-ecff9f879a8d" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-06df343c-eaf1-4929-9e25-ecff9f879a8d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleting offline snapshot 06df343c-eaf1-4929-9e25-ecff9f879a8d of volume 10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] snapshot_file for this snap is: volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[81281824-33bc-4ddb-8612-c224108a5321]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info" returned: 0 in 0.425s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:35 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info is being set with open permissions: ugo+rw Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:35 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info Aug 25 07:08:35 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:35 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d Aug 25 07:08:35 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "cinder-quobyte-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:36 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.536s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c589bf-c9ac-4fb6-b353-6dd3bf4495b1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4cba2f8-89af-41d5-b861-f1f6c7190d86 tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-c9cfe184-8371-4f0b-a2b6-dbe95140223c-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:36 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.info" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:36 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 Aug 25 07:08:36 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d62cf13-8619-4845-bb01-a6362322c6dd tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:08:36 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d" returned: 0 in 0.699s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bd0819-3f41-4ee1-9f5d-1189804b069d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88db269-cd5d-4ad8-9564-f626b465a636]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:36 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" returned: 0 in 0.484s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:36 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d Aug 25 07:08:36 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:36 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9 Aug 25 07:08:36 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-dc7a3f10-607a-4953-b15e-002979e4de82-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-dc7a3f10-607a-4953-b15e-002979e4de82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-dc7a3f10-607a-4953-b15e-002979e4de82" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-dc7a3f10-607a-4953-b15e-002979e4de82" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot dc7a3f10-607a-4953-b15e-002979e4de82 of volume f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4dc2f0-cbb3-478b-a0a3-0169f4303dbd]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:36 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:36 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 Aug 25 07:08:36 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:36 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d Aug 25 07:08:36 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:36 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" returned: 0 in 0.358s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-quobyte-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9" released by "delete_volume" :: held 0.900s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:36 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Created reservations ['b3175d11-a8ea-4ba1-b5b8-11f9c3c09dac', '1263debb-27d4-43d5-8d71-2ed9400a534a', 'ec7d5ee1-0e14-4fd9-8bc9-ffe16477ecfd', '476efec4-829a-4375-9965-31b837f689f0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:37 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82" returned: 0 in 0.439s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f316c408-0248-4460-aa40-9afea9ea6a0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdcc35a-20d2-4c7b-bbc2-353867c7b171]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.300s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Deleted volume successfully. Aug 25 07:08:37 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d Aug 25 07:08:37 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d Aug 25 07:08:37 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7e7f3aa2-8036-4580-b338-c9fc8215bfe2 tempest-CinderUnicodeTest-132799817 None] Lock "cinder-f2cbc0ed-9f68-43fc-8bc1-6b7969c8e4f9-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:37 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d.06df343c-eaf1-4929-9e25-ecff9f879a8d" returned: 0 in 0.480s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-06df343c-eaf1-4929-9e25-ecff9f879a8d" released by "_delete_snapshot" :: held 2.202s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" released by "delete_snapshot" :: held 2.234s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:37 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d" returned: 0 in 0.694s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 Aug 25 07:08:37 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['5aa21418-51fa-4ee2-a471-e62922671d00', 'a2cd35c5-5089-4ff5-98b7-db7956ce9b34', '44c6251f-eead-4ecc-badf-3d8fa9738ce9', '3ae67026-2b58-45ea-995f-8938add513c7'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:38 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Delete snapshot completed successfully. Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-db2cf16a-91e2-43cb-9172-16e2046aed6c tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-06df343c-eaf1-4929-9e25-ecff9f879a8d-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:38 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82" returned: 0 in 0.477s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:38 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82 Aug 25 07:08:38 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:38 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d.dc7a3f10-607a-4953-b15e-002979e4de82" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-dc7a3f10-607a-4953-b15e-002979e4de82" released by "_delete_snapshot" :: held 2.034s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" released by "delete_snapshot" :: held 2.065s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Created reservations ['eb37063f-e274-4b55-b6e6-22eb0e7c34ea', 'b130f48d-062d-493b-bee9-7f0adf0a9fd4', '47f7d1e0-3e60-4e90-ab4d-a1b346fcdc4c', '30e53767-0211-4bcb-bca6-e1603448a1f6'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-10bd0819-3f41-4ee1-9f5d-1189804b069d-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:38 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-3574a00a-757e-4ffe-a379-bda1c01dd711 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-dc7a3f10-607a-4953-b15e-002979e4de82-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-10bd0819-3f41-4ee1-9f5d-1189804b069d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d8750b-0c75-467a-99ae-1d4a041afbbf]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:39 devstack sudo[114781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d Aug 25 07:08:39 devstack sudo[114781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:39 devstack sudo[114781]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d" returned: 0 in 0.400s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:39 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d Aug 25 07:08:39 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:39 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-10bd0819-3f41-4ee1-9f5d-1189804b069d" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-quobyte-10bd0819-3f41-4ee1-9f5d-1189804b069d" released by "delete_volume" :: held 0.796s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Created reservations ['c7530de3-dd93-44c9-ade0-d489c88719f4', '64fd419a-6730-4639-a73e-b326eeab5c77', 'c352939e-7493-432c-9ed2-ba34c8ae4333', 'e97205b0-28b7-4d93-a95c-3fd9511cdda7'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-f316c408-0248-4460-aa40-9afea9ea6a0d-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f316c408-0248-4460-aa40-9afea9ea6a0d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" acquired by "delete_volume" :: waited 0.049s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc81f0f5-93c9-4536-8c51-e4a8d3b639c7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:40 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:40 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d Aug 25 07:08:40 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:40 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.523s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:40 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Deleted volume successfully. Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0744df4d-b295-4d13-80aa-dcdfab462ebe tempest-CreateVolumesFromSnapshotTest-110927016 None] Lock "cinder-10bd0819-3f41-4ee1-9f5d-1189804b069d-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:40 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d" returned: 0 in 0.624s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d Aug 25 07:08:40 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:41 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f316c408-0248-4460-aa40-9afea9ea6a0d" returned: 0 in 0.496s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f316c408-0248-4460-aa40-9afea9ea6a0d" released by "delete_volume" :: held 1.257s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Created reservations ['2cbfe6a9-9ac2-4691-b6ff-6a9ecc6b2904', 'c70253d6-f3b0-4bda-9756-91a476b6c83c', 'fd05c9f5-908b-46c1-b62b-8525cca647fa', 'c6d26baf-1332-4425-90e5-62a1d82d36f5'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:41 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:41 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:42 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.334s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:42 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:08:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-bc776ba9-5869-4aee-9b30-83f5a1a81bee tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f316c408-0248-4460-aa40-9afea9ea6a0d-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:42 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (09f0fe21-6023-49a7-946e-1a7695a1f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af89400a-a6f0-478d-a452-3949a4184a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af89400a-a6f0-478d-a452-3949a4184a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793634822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d435f50e-ca30-48ca-b261-09c3709e4637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:43Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4602a1a-770b-48f9-a0e5-1abf6d2ade78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4602a1a-770b-48f9-a0e5-1abf6d2ade78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e42d7-9e26-41a9-9a87-a085629011cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e42d7-9e26-41a9-9a87-a085629011cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd435f50e-ca30-48ca-b261-09c3709e4637', 'volume_name': 'volume-d435f50e-ca30-48ca-b261-09c3709e4637', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4df47-4e02-4dca-a57c-9d93bb0057df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4df47-4e02-4dca-a57c-9d93bb0057df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1cc408-24ae-4ae7-a478-65285093ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:43 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Volume d435f50e-ca30-48ca-b261-09c3709e4637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d435f50e-ca30-48ca-b261-09c3709e4637', 'volume_size': 1} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793634822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d435f50e-ca30-48ca-b261-09c3709e4637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:43Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Creating volume d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:43 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:43 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 1073741824 Aug 25 07:08:43 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:43 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 1073741824" returned: 0 in 0.740s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:43 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 Aug 25 07:08:43 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:44 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637" returned: 0 in 0.356s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1cc408-24ae-4ae7-a478-65285093ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d435f50e-ca30-48ca-b261-09c3709e4637', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d083d1-da53-4758-b712-c5242385262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Volume volume-d435f50e-ca30-48ca-b261-09c3709e4637 (d435f50e-ca30-48ca-b261-09c3709e4637): created successfully Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d083d1-da53-4758-b712-c5242385262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (09f0fe21-6023-49a7-946e-1a7695a1f505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-396f81be-2a1d-4133-bedb-33b1a8fcac56 tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (a0d5d3e3-713f-4447-9b97-4199d1285281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cae37f-aa7d-415b-8bdd-52069a571981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cae37f-aa7d-415b-8bdd-52069a571981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083240874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348719d1-05c7-42f2-9cf9-a4e5ff4b14e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:45Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e552677-a394-44b8-9eeb-73c3a7457b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e552677-a394-44b8-9eeb-73c3a7457b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f8f814-ba9e-40cf-89d4-4d800da80816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f8f814-ba9e-40cf-89d4-4d800da80816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348719d1-05c7-42f2-9cf9-a4e5ff4b14e3', 'volume_name': 'volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97476525-8d11-46da-a3c3-39393e9aac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97476525-8d11-46da-a3c3-39393e9aac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce2dd7-d160-4d65-af01-5d9769ed5706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume 348719d1-05c7-42f2-9cf9-a4e5ff4b14e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3', 'volume_size': 1} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083240874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348719d1-05c7-42f2-9cf9-a4e5ff4b14e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:45Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume 348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:44 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:44 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 1073741824 Aug 25 07:08:44 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:45 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 1073741824" returned: 0 in 0.638s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:45 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 Aug 25 07:08:45 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:45 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" returned: 0 in 0.321s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.305s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce2dd7-d160-4d65-af01-5d9769ed5706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f0285-1953-403c-93fa-5f260d443189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot e0942a62-647d-4964-a988-3ed32ff497a8 of volume d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 (348719d1-05c7-42f2-9cf9-a4e5ff4b14e3): created successfully Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f0285-1953-403c-93fa-5f260d443189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (a0d5d3e3-713f-4447-9b97-4199d1285281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d052882-2547-4d7a-bf5e-98638ae5f367]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-34220f50-449e-4f21-b171-fcbd9cd77028 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:46 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 Aug 25 07:08:46 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:46 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:46 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 1G Aug 25 07:08:46 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:46 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 1G" returned: 0 in 0.586s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d435f50e-ca30-48ca-b261-09c3709e4637 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:46 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d435f50e-ca30-48ca-b261-09c3709e4637 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 Aug 25 07:08:46 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:47 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d435f50e-ca30-48ca-b261-09c3709e4637 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8" returned: 0 in 0.539s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:47 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 is being set with open permissions: ugo+rw Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:47 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 Aug 25 07:08:47 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=189,cinder:UPDATE=278,cinder:INSERT=68,cinder:DELETE=19 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:UPDATE=239,cinder:SELECT=201,cinder:INSERT=73,cinder:DELETE=27 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (b6cb8897-ddb1-46d5-a4a3-54da33a141c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dd4270-93f5-46b9-901b-9ea5195c7a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dd4270-93f5-46b9-901b-9ea5195c7a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742950532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce300f7-e452-4d55-a51a-80ff5b8e43b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:47Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b015ca-5cd9-449d-b03e-bde3d7cb29f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b015ca-5cd9-449d-b03e-bde3d7cb29f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52af00c-bf02-4381-a598-08abb2072a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52af00c-bf02-4381-a598-08abb2072a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce300f7-e452-4d55-a51a-80ff5b8e43b3', 'volume_name': 'volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49382a-8990-4ccd-b668-61189e8aa60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49382a-8990-4ccd-b668-61189e8aa60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8123ac5-50d8-4bed-bbf4-6685f9b15cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:47 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume 8ce300f7-e452-4d55-a51a-80ff5b8e43b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3', 'volume_size': 1} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:47 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:48 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info Aug 25 07:08:48 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (e2ee4148-acc5-4fcc-8333-29a386a21afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:48 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b88dd36-689d-41c0-8fb5-8218775248e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info" returned: 0 in 0.368s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:48 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info is being set with open permissions: ugo+rw Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b88dd36-689d-41c0-8fb5-8218775248e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-669349985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:48Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:48 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info Aug 25 07:08:48 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f515ee7-5b50-43da-bbec-601d7e1a86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f515ee7-5b50-43da-bbec-601d7e1a86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd81125-79ae-48fc-8a32-c44d7e132c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd81125-79ae-48fc-8a32-c44d7e132c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8', 'volume_name': 'volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdeb61a-bf45-4df9-9329-78a5c980f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdeb61a-bf45-4df9-9329-78a5c980f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced06d70-8a9f-4500-ba1e-37ad51e6ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8', 'volume_size': 1} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:48 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.info" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.036s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742950532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce300f7-e452-4d55-a51a-80ff5b8e43b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:47Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume 8ce300f7-e452-4d55-a51a-80ff5b8e43b3 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:48 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:48 devstack sudo[114854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 1073741824 Aug 25 07:08:48 devstack sudo[114854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:48 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-493725c5-9f66-4776-9c0f-86d36224dba2 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (40ffc748-012a-4a99-bab5-18a7c2d87db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f4fe88-cf4c-4119-a247-30bb66c12137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:48 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f4fe88-cf4c-4119-a247-30bb66c12137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595029313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c344ea40-a22a-4814-9832-37fbd87ad3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:49Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3786f6d0-c7cc-4f99-936b-204fee12e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3786f6d0-c7cc-4f99-936b-204fee12e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da25945a-e388-49b1-b2ee-8834b9ffa6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da25945a-e388-49b1-b2ee-8834b9ffa6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c344ea40-a22a-4814-9832-37fbd87ad3bb', 'volume_name': 'volume-c344ea40-a22a-4814-9832-37fbd87ad3bb', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cffdeb-1d19-4606-a745-b8265b8d197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cffdeb-1d19-4606-a745-b8265b8d197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f69a0ab-651d-49f6-99d2-713a957e2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume c344ea40-a22a-4814-9832-37fbd87ad3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c344ea40-a22a-4814-9832-37fbd87ad3bb', 'volume_size': 1} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:49 devstack sudo[114854]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 1073741824" returned: 0 in 0.713s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (412c4fe5-ffd5-46d2-bb60-cf6efc8b4e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1faaa0-149d-42ce-9ea4-3533bcbb9c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1faaa0-149d-42ce-9ea4-3533bcbb9c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939619259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:49Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650f9ca4-6235-4cf7-bb9f-e7af80661d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650f9ca4-6235-4cf7-bb9f-e7af80661d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26ac07-386b-4270-a1e0-4e802c84b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26ac07-386b-4270-a1e0-4e802c84b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d', 'volume_name': 'volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d634f08f-fb2b-430f-85dd-772322d9590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d634f08f-fb2b-430f-85dd-772322d9590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47a5927-7f8e-451b-9525-1b55abea809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:49 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d', 'volume_size': 1} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:49 devstack sudo[114860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 Aug 25 07:08:49 devstack sudo[114860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-e0942a62-647d-4964-a988-3ed32ff497a8-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-e0942a62-647d-4964-a988-3ed32ff497a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-e0942a62-647d-4964-a988-3ed32ff497a8" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-e0942a62-647d-4964-a988-3ed32ff497a8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot e0942a62-647d-4964-a988-3ed32ff497a8 of volume d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a91363-54ce-469f-bd23-a056bbd563ed]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:49 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (2c4213cc-44b6-46f9-ad2e-4277ef536c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2df8db-8822-4f70-b431-72089738da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2df8db-8822-4f70-b431-72089738da7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757076893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6301248-a27c-4234-9956-f4aa21750333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:50Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29ff47c-7f71-49ac-87a9-a7a2222f0720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29ff47c-7f71-49ac-87a9-a7a2222f0720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c2dc86-a1fe-4706-92b9-6768323e9b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c2dc86-a1fe-4706-92b9-6768323e9b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6301248-a27c-4234-9956-f4aa21750333', 'volume_name': 'volume-d6301248-a27c-4234-9956-f4aa21750333', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d965e15a-0b70-4ded-984e-9fc61084cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d965e15a-0b70-4ded-984e-9fc61084cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 Aug 25 07:08:50 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976614dc-6e91-49ff-bf82-8e39c3f58c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume d6301248-a27c-4234-9956-f4aa21750333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6301248-a27c-4234-9956-f4aa21750333', 'volume_size': 1} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:50 devstack sudo[114860]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" returned: 0 in 0.438s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-669349985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:48Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:50 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8123ac5-50d8-4bed-bbf4-6685f9b15cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack sudo[114865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 1073741824 Aug 25 07:08:50 devstack sudo[114865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84676-da17-4b45-86c8-37b16c08f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 (8ce300f7-e452-4d55-a51a-80ff5b8e43b3): created successfully Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84676-da17-4b45-86c8-37b16c08f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (b6cb8897-ddb1-46d5-a4a3-54da33a141c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:50 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1a9d8b60-e563-4d76-b8fe-5b0084d0b985 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:50 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8" returned: 0 in 0.638s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d435f50e-ca30-48ca-b261-09c3709e4637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d53411-73ab-4ce0-8737-2d1a3c04a0a6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:50 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 Aug 25 07:08:50 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:50 devstack sudo[114865]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (003930fc-f180-4f4e-8538-788f134a7986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30faa676-7184-4954-b8c0-fdb3ce97b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 1073741824" returned: 0 in 0.790s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:50 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30faa676-7184-4954-b8c0-fdb3ce97b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682667369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb4b7a-e393-4333-90ae-e93a2692b81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:51Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b05a48c-ba2c-4a51-8eef-82685a4f8688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b05a48c-ba2c-4a51-8eef-82685a4f8688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc7a365-a180-47b7-a45b-a3c0c63aeb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc7a365-a180-47b7-a45b-a3c0c63aeb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33eb4b7a-e393-4333-90ae-e93a2692b81f', 'volume_name': 'volume-33eb4b7a-e393-4333-90ae-e93a2692b81f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccd3a0-ee5d-470a-a338-403e6661788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccd3a0-ee5d-470a-a338-403e6661788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a965626-a60b-4610-b3f2-9e5e79a8c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Volume 33eb4b7a-e393-4333-90ae-e93a2692b81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33eb4b7a-e393-4333-90ae-e93a2692b81f', 'volume_size': 1} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:51 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637" returned: 0 in 0.506s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:51 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 Aug 25 07:08:51 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:51 devstack sudo[114881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 Aug 25 07:08:51 devstack sudo[114881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:51 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595029313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c344ea40-a22a-4814-9832-37fbd87ad3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:49Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume c344ea40-a22a-4814-9832-37fbd87ad3bb {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:51 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced06d70-8a9f-4500-ba1e-37ad51e6ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dbf4ca-1dab-4cf8-988b-1732235f762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:51 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb 1073741824 Aug 25 07:08:51 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:51 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 (e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8): created successfully Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dbf4ca-1dab-4cf8-988b-1732235f762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (e2ee4148-acc5-4fcc-8333-29a386a21afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-bf51409d-07a1-47f2-ae7e-d9468bd1e3f6 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:51 devstack sudo[114881]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8" returned: 0 in 0.391s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:51 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8 Aug 25 07:08:51 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:51 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637.e0942a62-647d-4964-a988-3ed32ff497a8" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-e0942a62-647d-4964-a988-3ed32ff497a8" released by "_delete_snapshot" :: held 1.978s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" released by "delete_snapshot" :: held 2.012s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Created reservations ['2f821115-eb9b-461c-95aa-7c2793507d9a', 'd52fc5d1-1a0e-4388-b32e-36c30f602b90', '41b0bcd1-90bb-4156-8d74-dfd26cc80adc', '2bcf0879-0051-466e-a40b-b7ab543d55d8'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f1a6b055-e315-4dfb-a39a-e4e2041e5a57 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-e0942a62-647d-4964-a988-3ed32ff497a8-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:52 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb 1073741824" returned: 0 in 0.749s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-d435f50e-ca30-48ca-b261-09c3709e4637-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-d435f50e-ca30-48ca-b261-09c3709e4637-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:52 devstack sudo[114896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb Aug 25 07:08:52 devstack sudo[114896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd5cf1c-df7e-4c80-a17c-48f568f4c001]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:52 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 Aug 25 07:08:52 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:52 devstack sudo[114896]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb" returned: 0 in 0.292s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.766s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939619259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:49Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:52 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f69a0ab-651d-49f6-99d2-713a957e2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c344ea40-a22a-4814-9832-37fbd87ad3bb', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e61461-a5cc-40d4-a0c5-8b6eb17ee3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:52 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d 1073741824 Aug 25 07:08:52 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-c344ea40-a22a-4814-9832-37fbd87ad3bb (c344ea40-a22a-4814-9832-37fbd87ad3bb): created successfully Aug 25 07:08:52 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e61461-a5cc-40d4-a0c5-8b6eb17ee3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (40ffc748-012a-4a99-bab5-18a7c2d87db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:52 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-58930e76-b7cf-4df0-953a-e4d93217e55b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:52 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:52 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637 Aug 25 07:08:52 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:53 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d435f50e-ca30-48ca-b261-09c3709e4637" returned: 0 in 0.285s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:53 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d 1073741824" returned: 0 in 0.549s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-d435f50e-ca30-48ca-b261-09c3709e4637" released by "delete_volume" :: held 0.770s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:53 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d Aug 25 07:08:53 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Created reservations ['9ed8c3f7-5b75-434f-868a-236b878325f6', 'b992a9da-4d2f-4fca-8a20-72d0234500d3', 'a79cb438-cff9-43dd-ae4a-2fa35c3e7135', '1e3adb1a-88af-433b-8976-575247c91924'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:53 devstack sudo[114915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:53 devstack sudo[114915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:53 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" returned: 0 in 0.377s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.391s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757076893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6301248-a27c-4234-9956-f4aa21750333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b61e408195b447aa53fecdb1ce0b715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:50Z,use_quota=True,user_id='c97e447f2d03481193d1be9c14e46e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Creating volume d6301248-a27c-4234-9956-f4aa21750333 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:53 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47a5927-7f8e-451b-9525-1b55abea809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:53 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 1073741824 Aug 25 07:08:53 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1a1c76-a382-4260-a240-bb858403e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:53 devstack sudo[114915]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.349s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:08:53 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d (b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d): created successfully Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1a1c76-a382-4260-a240-bb858403e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (412c4fe5-ffd5-46d2-bb60-cf6efc8b4e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-f6034ce3-fa78-41b3-80a9-d58cacfdb561 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-d435f50e-ca30-48ca-b261-09c3709e4637-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0004be2e-5f12-43fd-8a9e-69c264972e94 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:53 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (44bab55b-b72e-49d1-b92e-25bd9e57bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6bed0b-3aae-40e2-b50f-14e240fdda78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6bed0b-3aae-40e2-b50f-14e240fdda78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137921986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f468af17-fc4c-4056-baae-838eed5c10f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:54Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b266ce7-c8ee-4a33-8634-cb2cda868077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b266ce7-c8ee-4a33-8634-cb2cda868077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a74b2a9-9025-4314-a3ee-7f55a614f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a74b2a9-9025-4314-a3ee-7f55a614f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f468af17-fc4c-4056-baae-838eed5c10f5', 'volume_name': 'volume-f468af17-fc4c-4056-baae-838eed5c10f5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4385022-5134-4484-95f3-e289d6dfd21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4385022-5134-4484-95f3-e289d6dfd21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708d6f68-bbfa-4492-a78c-d1044267181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Volume f468af17-fc4c-4056-baae-838eed5c10f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f468af17-fc4c-4056-baae-838eed5c10f5', 'volume_size': 1} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 1073741824" returned: 0 in 0.586s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:54 devstack sudo[114925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 Aug 25 07:08:54 devstack sudo[114925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:54 devstack sudo[114925]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.384s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682667369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb4b7a-e393-4333-90ae-e93a2692b81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:51Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Creating volume 33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:54 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:54 devstack sudo[114928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f 1073741824 Aug 25 07:08:54 devstack sudo[114928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976614dc-6e91-49ff-bf82-8e39c3f58c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6301248-a27c-4234-9956-f4aa21750333', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3cd04-4c38-4c39-9ed9-b56ee18d147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Volume volume-d6301248-a27c-4234-9956-f4aa21750333 (d6301248-a27c-4234-9956-f4aa21750333): created successfully Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3cd04-4c38-4c39-9ed9-b56ee18d147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Flow 'volume_create_manager' (2c4213cc-44b6-46f9-ad2e-4277ef536c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b4e379f0-9414-41b1-bc7a-dd990193897c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created volume successfully. Aug 25 07:08:54 devstack sudo[114928]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f 1073741824" returned: 0 in 0.520s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:55 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f Aug 25 07:08:55 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:55 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f" returned: 0 in 0.286s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137921986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f468af17-fc4c-4056-baae-838eed5c10f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:54Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Creating volume f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:55 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a965626-a60b-4610-b3f2-9e5e79a8c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33eb4b7a-e393-4333-90ae-e93a2692b81f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:55 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 1073741824 Aug 25 07:08:55 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ac83cd-58f9-4df3-a5fe-87026f4d9460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:55 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Volume volume-33eb4b7a-e393-4333-90ae-e93a2692b81f (33eb4b7a-e393-4333-90ae-e93a2692b81f): created successfully Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ac83cd-58f9-4df3-a5fe-87026f4d9460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (003930fc-f180-4f4e-8538-788f134a7986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:55 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b220538f-e252-4726-9de0-7dbec25b4dfa tempest-ProjectReaderTests-139380445 None] Created volume successfully. Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-d6301248-a27c-4234-9956-f4aa21750333-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-d6301248-a27c-4234-9956-f4aa21750333-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-d6301248-a27c-4234-9956-f4aa21750333" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-d6301248-a27c-4234-9956-f4aa21750333" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbeabcc-bd36-4c56-a5f6-9a328372d39a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:55 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 1073741824" returned: 0 in 0.538s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:55 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 Aug 25 07:08:55 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:55 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 Aug 25 07:08:55 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:56 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5" returned: 0 in 0.314s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708d6f68-bbfa-4492-a78c-d1044267181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f468af17-fc4c-4056-baae-838eed5c10f5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f24667-5050-4c12-a0cc-29ed401ea12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:56 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Volume volume-f468af17-fc4c-4056-baae-838eed5c10f5 (f468af17-fc4c-4056-baae-838eed5c10f5): created successfully Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f24667-5050-4c12-a0cc-29ed401ea12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:56 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (44bab55b-b72e-49d1-b92e-25bd9e57bb84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333" returned: 0 in 0.457s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:56 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1173e274-20c4-4dea-99e8-c2c743272a15 tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:08:56 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333 Aug 25 07:08:56 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Creating offline snapshot cff0de89-6efb-4c99-be3a-9fa3df80db82 of volume 33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c057ea0-0eb2-44ae-af24-3e13355c2804]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:56 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d6301248-a27c-4234-9956-f4aa21750333" returned: 0 in 0.311s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-d6301248-a27c-4234-9956-f4aa21750333" released by "delete_volume" :: held 0.833s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['52e901f8-3bdf-4a46-80b6-1af3be59e890', '9614a2c6-f985-4750-bfb6-fee6f7a62fb7', 'ca6c5e23-ae93-42ef-99e2-da19ea12f9d3', '04f0f918-391a-4269-b41f-d132950569b0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:56 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f Aug 25 07:08:56 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:56 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:56 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:56 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[562735a5-f8fe-4555-aade-3b33b7d2339f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:57 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:08:57 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f" returned: 0 in 0.580s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d33ffd1c-0844-4540-a44d-7629d7d4915b tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-d6301248-a27c-4234-9956-f4aa21750333-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:57 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 1G Aug 25 07:08:57 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:57 devstack sudo[114962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d Aug 25 07:08:57 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:57 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" returned: 0 in 0.516s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:57 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d Aug 25 07:08:57 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:57 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 1G" returned: 0 in 0.568s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb4b7a-e393-4333-90ae-e93a2692b81f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:57 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb4b7a-e393-4333-90ae-e93a2692b81f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 Aug 25 07:08:57 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:57 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:57 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d" released by "delete_volume" :: held 0.928s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['11de7ad0-4df4-4cc7-871e-6e7ac668c1e4', '473bf4d0-7514-4262-a493-af396688829e', '9cc90b16-108d-48c2-a5a2-e1cc83f820c9', 'e4d39886-506a-488f-b238-31fa65aa5c5a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:58 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb4b7a-e393-4333-90ae-e93a2692b81f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:58 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 is being set with open permissions: ugo+rw Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:58 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 Aug 25 07:08:58 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-c344ea40-a22a-4814-9832-37fbd87ad3bb-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-c344ea40-a22a-4814-9832-37fbd87ad3bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:58 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:58 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-c344ea40-a22a-4814-9832-37fbd87ad3bb" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-c344ea40-a22a-4814-9832-37fbd87ad3bb" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[531cbc5b-91d4-4847-9462-885e4bb06e6b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:58 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:08:58 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82" returned: 0 in 0.449s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1b896e0a-e7ea-4734-bb0e-3838046a981d tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-b1d2d8ea-cc7d-4294-a04d-6ccca49dfe5d-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack sudo[115026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info Aug 25 07:08:58 devstack sudo[115026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:58 devstack sudo[115023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb Aug 25 07:08:58 devstack sudo[115023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:58 devstack sudo[115026]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info" returned: 0 in 0.309s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:58 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info is being set with open permissions: ugo+rw Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack sudo[115023]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:58 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb" returned: 0 in 0.483s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:58 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:59 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb Aug 25 07:08:59 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:59 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.info" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.693s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:59 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-c344ea40-a22a-4814-9832-37fbd87ad3bb" returned: 0 in 0.301s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 4626725c-add6-4565-a8d8-c57e6b94a31d of volume f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-c344ea40-a22a-4814-9832-37fbd87ad3bb" released by "delete_volume" :: held 0.849s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-431f3c09-9e65-43c4-9467-a16b165dbd98 tempest-ProjectReaderTests-139380445 None] Create snapshot completed successfully Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3b170-2c0d-40d3-98d9-6fa01746b535]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['fcae882d-d2bf-45f9-b832-c2cc08659515', 'e3057fbc-1c91-4646-a0f9-df5ec1b16add', '25aec9df-d929-4f39-a7e8-d15a6de2ddd0', '63d1dad2-2045-469b-8b0a-48298c3a0b0c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:59 devstack sudo[115045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:08:59 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:59 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 Aug 25 07:08:59 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:59 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.300s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:59 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4b3e4fa3-dfa9-4d37-b257-47ad6232bf38 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-c344ea40-a22a-4814-9832-37fbd87ad3bb-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:59 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-cff0de89-6efb-4c99-be3a-9fa3df80db82-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5" returned: 0 in 0.594s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-cff0de89-6efb-4c99-be3a-9fa3df80db82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:59 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d 1G Aug 25 07:08:59 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-cff0de89-6efb-4c99-be3a-9fa3df80db82" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-cff0de89-6efb-4c99-be3a-9fa3df80db82" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Deleting offline snapshot cff0de89-6efb-4c99-be3a-9fa3df80db82 of volume 33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:59 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] snapshot_file for this snap is: volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda8b53-15fd-4396-8ec5-6dd4ae63231b]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack sudo[115055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 Aug 25 07:09:00 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d 1G" returned: 0 in 0.487s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f468af17-fc4c-4056-baae-838eed5c10f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack sudo[115063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f468af17-fc4c-4056-baae-838eed5c10f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d Aug 25 07:09:00 devstack sudo[115063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82" returned: 0 in 0.470s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33eb4b7a-e393-4333-90ae-e93a2692b81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Flow 'volume_create_manager' (eafae14b-5f89-4e09-9f29-07e22749a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a444363-a3a7-48cb-b7b3-58e38e1e6b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb0f48a-2c90-4446-ad75-801ae3260de6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a444363-a3a7-48cb-b7b3-58e38e1e6b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761285363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d309cae2-84d3-4a6d-8e06-8da0543123fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9431ac9406934b9fbafee9ba344b279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:00Z,use_quota=True,user_id='bbf5a88c2c004b6e9f3d1b20eae30081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235cacb3-629c-496b-b8a2-9c7d3d99f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235cacb3-629c-496b-b8a2-9c7d3d99f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34909c-d5e7-4956-94ed-0aac487e2421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34909c-d5e7-4956-94ed-0aac487e2421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd309cae2-84d3-4a6d-8e06-8da0543123fa', 'volume_name': 'volume-d309cae2-84d3-4a6d-8e06-8da0543123fa', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e934e999-4468-4ba7-9bdc-d5e261883429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e934e999-4468-4ba7-9bdc-d5e261883429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982584c8-8b45-43b3-8c5b-ff2578b0704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:00 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Volume d309cae2-84d3-4a6d-8e06-8da0543123fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d309cae2-84d3-4a6d-8e06-8da0543123fa', 'volume_size': 1} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:00 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f Aug 25 07:09:00 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8874f7c0-5209-40fe-82d1-8581827a7d10]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack sudo[115063]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f468af17-fc4c-4056-baae-838eed5c10f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:00 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d is being set with open permissions: ugo+rw Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:00 devstack sudo[115072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:00 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:00 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 Aug 25 07:09:00 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:00 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f" returned: 0 in 0.416s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 Aug 25 07:09:01 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d" returned: 0 in 0.309s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info Aug 25 07:09:01 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" returned: 0 in 0.440s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8 Aug 25 07:09:01 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info" returned: 0 in 0.277s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info is being set with open permissions: ugo+rw Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82" returned: 0 in 0.439s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info Aug 25 07:09:01 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82 Aug 25 07:09:01 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" returned: 0 in 0.290s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8" released by "delete_volume" :: held 0.777s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['2ba23a0a-2c98-406f-a057-7088637aad0f', '57ff0b93-9523-4f29-a1be-4630aa062e7f', 'ac95aaf4-939d-4e1b-bc7c-6e3693201ef5', 'c0a89841-582a-4f2e-84f0-c44b4fc4ff88'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack sudo[115101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:01 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.info" returned: 0 in 0.327s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761285363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d309cae2-84d3-4a6d-8e06-8da0543123fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9431ac9406934b9fbafee9ba344b279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:00Z,use_quota=True,user_id='bbf5a88c2c004b6e9f3d1b20eae30081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Creating volume d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:01 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-8ce300f7-e452-4d55-a51a-80ff5b8e43b3-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:01 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa 1073741824 Aug 25 07:09:01 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f.cff0de89-6efb-4c99-be3a-9fa3df80db82" returned: 0 in 0.418s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-cff0de89-6efb-4c99-be3a-9fa3df80db82" released by "_delete_snapshot" :: held 1.906s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-8ce300f7-e452-4d55-a51a-80ff5b8e43b3-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" released by "delete_snapshot" :: held 1.941s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7a173d79-a1f6-4e4f-908f-0279bdc7f162 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:01 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:09:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" acquired by "delete_volume" :: waited 0.028s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98dcc396-55c2-4581-9774-62c80788e64c tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-e1e4c3cc-52eb-43cf-bd90-1a54d560f5e8-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1b76b-949b-4973-82dd-9a1388efe5ac]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Created reservations ['77ea8826-7da7-47b1-85e6-b5fd1a5ccd97', 'a309be2c-8841-4ce1-9572-46134fffb2ab', '4b1a241e-c54c-4ea4-b604-5e2451158ee2', 'b4f9ddc5-8a65-4e00-b6b3-a585b2fee21e'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Delete snapshot completed successfully. Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-1d893ed6-b3c1-4604-b45c-8da3bd49c3cc tempest-ProjectReaderTests-139380445 None] Lock "cinder-cff0de89-6efb-4c99-be3a-9fa3df80db82-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:02 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 Aug 25 07:09:02 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:02 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa 1073741824" returned: 0 in 0.537s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:02 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:02 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:02 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" returned: 0 in 0.394s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:02 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3 Aug 25 07:09:02 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:02 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.257s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982584c8-8b45-43b3-8c5b-ff2578b0704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d309cae2-84d3-4a6d-8e06-8da0543123fa', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef840f-97c9-4422-8999-afa8ad0c1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Volume volume-d309cae2-84d3-4a6d-8e06-8da0543123fa (d309cae2-84d3-4a6d-8e06-8da0543123fa): created successfully Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef840f-97c9-4422-8999-afa8ad0c1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Flow 'volume_create_manager' (eafae14b-5f89-4e09-9f29-07e22749a06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:02 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fd8d2b5c-d456-491d-bf7c-9c70072345b7 tempest-SnapshotDependencyTests-467385890 None] Created volume successfully. Aug 25 07:09:02 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" returned: 0 in 0.277s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-8ce300f7-e452-4d55-a51a-80ff5b8e43b3" released by "delete_volume" :: held 0.729s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['7428c16b-8094-476b-b0b0-3634c06ce49a', '413bd747-39dc-4403-b7ed-15afe85b9a13', '8dc4cec0-83cc-4cf6-820a-8e3fffeff276', 'b97df971-65b0-452a-960b-7b0e5706bd2a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-4626725c-add6-4565-a8d8-c57e6b94a31d-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-4626725c-add6-4565-a8d8-c57e6b94a31d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:02 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:02 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-4626725c-add6-4565-a8d8-c57e6b94a31d" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-4626725c-add6-4565-a8d8-c57e6b94a31d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 4626725c-add6-4565-a8d8-c57e6b94a31d of volume f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f523e8-838c-4383-9ade-a7c55d226a1d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:02 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "cinder-quobyte-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:03 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d Aug 25 07:09:03 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[27871f54-5a08-4208-a7e6-94532be144d6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-33eb4b7a-e393-4333-90ae-e93a2692b81f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.333s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-33eb4b7a-e393-4333-90ae-e93a2692b81f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6100d0df-10d4-4b2a-bd7d-160970d33816 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-8ce300f7-e452-4d55-a51a-80ff5b8e43b3-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" acquired by "delete_volume" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:03 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 Aug 25 07:09:03 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1414f-cca5-45e3-8839-159df73f2987]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d" returned: 0 in 0.442s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f468af17-fc4c-4056-baae-838eed5c10f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d243006-e2de-4e6b-9f41-6da9b2d603e8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f Aug 25 07:09:03 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 Aug 25 07:09:03 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" returned: 0 in 0.478s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3 Aug 25 07:09:03 devstack sudo[115139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f" returned: 0 in 0.413s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f Aug 25 07:09:03 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5" returned: 0 in 0.436s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:03 devstack sudo[115150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d Aug 25 07:09:03 devstack sudo[115150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:03 devstack sudo[115139]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" returned: 0 in 0.325s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-quobyte-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3" released by "delete_volume" :: held 0.865s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Creating offline snapshot f1dbce8e-489b-4811-9484-6deaac49732f of volume d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bbe0dd-2438-45a7-859a-1a3de4052932]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Created reservations ['6036c25b-66b3-4116-8d08-a6ee4b08a11c', 'b319883e-469e-4c79-8358-1483fb77c113', '2c285efb-6a3f-4542-ae54-b0ae5d7aa783', 'ae74b967-b961-4b7a-84b2-a2850aad1d2a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:04 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-33eb4b7a-e393-4333-90ae-e93a2692b81f" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33eb4b7a-e393-4333-90ae-e93a2692b81f" released by "delete_volume" :: held 0.867s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:04 devstack sudo[115153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:04 devstack sudo[115153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:04 devstack sudo[115157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:04 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Created reservations ['110df349-9ee7-436e-835f-a8ad77392d7d', '6997d244-6a4c-4603-8ef2-c7cab8d2d1c7', 'f19b998e-04aa-49e5-8af6-4df52f6e37ea', '1dff7f6e-258e-4c9a-b163-3d85789b846c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:04 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:04 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:04 devstack sudo[115150]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d" returned: 0 in 0.569s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:04 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d Aug 25 07:09:04 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:04 devstack sudo[115153]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.517s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:04 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.375s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Deleted volume successfully. Aug 25 07:09:04 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f 1G Aug 25 07:09:04 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b997cadb-014c-4da7-8f69-a5f8cb435504 tempest-CreateVolumesFromSourceVolumeTest-807364701 None] Lock "cinder-348719d1-05c7-42f2-9cf9-a4e5ff4b14e3-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:04 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Deleted volume successfully. Aug 25 07:09:04 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5.4626725c-add6-4565-a8d8-c57e6b94a31d" returned: 0 in 0.293s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-4626725c-add6-4565-a8d8-c57e6b94a31d" released by "_delete_snapshot" :: held 1.853s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-5a5796e2-62c5-4dfb-8d8c-ada95c30dad3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-33eb4b7a-e393-4333-90ae-e93a2692b81f-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" released by "delete_snapshot" :: held 1.878s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Created reservations ['32a620f2-1e91-46d7-9354-e4fac5f5d769', '5bce8138-aadf-4f86-bd25-6ed11a3c9998', 'e7834864-7ebe-494d-9ea3-159bf2bb41ee', '8eab90d7-fb80-49b1-9931-db93be98e809'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:04 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:09:04 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-03d9db57-65e6-453d-9bda-eacfdab47445 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-4626725c-add6-4565-a8d8-c57e6b94a31d-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-f468af17-fc4c-4056-baae-838eed5c10f5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f468af17-fc4c-4056-baae-838eed5c10f5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:05 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f 1G" returned: 0 in 0.626s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d309cae2-84d3-4a6d-8e06-8da0543123fa -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb2379-c22c-4fa4-9124-ea57099b6a5a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:05 devstack sudo[115177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d309cae2-84d3-4a6d-8e06-8da0543123fa -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:05 devstack sudo[115177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:05 devstack sudo[115178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 Aug 25 07:09:05 devstack sudo[115178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:05 devstack sudo[115177]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d309cae2-84d3-4a6d-8e06-8da0543123fa -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.353s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f is being set with open permissions: ugo+rw Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:05 devstack sudo[115184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:05 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:05 devstack sudo[115178]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5" returned: 0 in 0.446s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:05 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5 Aug 25 07:09:05 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:05 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:05 devstack sudo[115193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info Aug 25 07:09:05 devstack sudo[115193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:06 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f468af17-fc4c-4056-baae-838eed5c10f5" returned: 0 in 0.401s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f468af17-fc4c-4056-baae-838eed5c10f5" released by "delete_volume" :: held 0.927s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Created reservations ['6f5ed716-c474-4ecb-a422-5754320f7636', 'efc8e285-c791-4fea-8509-281ad6aeb619', '18681c1e-4102-4daa-bf65-9ed33eff7678', '92e5e121-d053-4889-a1ff-3cf95fa3b822'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (057a87f7-5b4b-44fe-8437-647dcb82a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aabd561-6c1e-4f55-93bb-fe21108a6198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aabd561-6c1e-4f55-93bb-fe21108a6198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551880268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97f9f2-acd6-4767-8575-5266837d1588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:06Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08b4728-88b1-49af-b928-3868384b197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08b4728-88b1-49af-b928-3868384b197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccfb88b-ff7e-419f-bde8-085406e65f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccfb88b-ff7e-419f-bde8-085406e65f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c97f9f2-acd6-4767-8575-5266837d1588', 'volume_name': 'volume-9c97f9f2-acd6-4767-8575-5266837d1588', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13fb1db-7b18-434a-8744-e93b06e569d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13fb1db-7b18-434a-8744-e93b06e569d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb94c45-5f7d-46ee-ab82-789f502b0795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:06 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Volume 9c97f9f2-acd6-4767-8575-5266837d1588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c97f9f2-acd6-4767-8575-5266837d1588', 'volume_size': 1} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:06 devstack sudo[115193]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:06 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info is being set with open permissions: ugo+rw Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:06 devstack sudo[115196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info Aug 25 07:09:06 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:06 devstack sudo[115198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:06 devstack sudo[115198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:06 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.info" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:06 devstack sudo[115198]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551880268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97f9f2-acd6-4767-8575-5266837d1588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:06Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Creating volume 9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:06 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.314s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:06 devstack sudo[115202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 1073741824 Aug 25 07:09:06 devstack sudo[115202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:09:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ba096868-9639-4def-976a-1819b42980e9 tempest-SnapshotDependencyTests-467385890 None] Create snapshot completed successfully Aug 25 07:09:06 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-44e95fdb-a24e-4749-8366-95fe7e1b83f9 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f468af17-fc4c-4056-baae-838eed5c10f5-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:07 devstack sudo[115202]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 1073741824" returned: 0 in 0.506s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:07 devstack sudo[115208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 Aug 25 07:09:07 devstack sudo[115208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:07 devstack sudo[115208]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588" returned: 0 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb94c45-5f7d-46ee-ab82-789f502b0795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c97f9f2-acd6-4767-8575-5266837d1588', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a7c03-b1f2-4eba-a4df-676aeb3863af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:07 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Volume volume-9c97f9f2-acd6-4767-8575-5266837d1588 (9c97f9f2-acd6-4767-8575-5266837d1588): created successfully Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a7c03-b1f2-4eba-a4df-676aeb3863af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:07 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (057a87f7-5b4b-44fe-8437-647dcb82a61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:07 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-75004ded-a9ab-464f-a55a-e19ddd186a8a tempest-ProjectReaderTests-139380445 None] Created volume successfully. Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (d29c11cc-93f3-4adc-9fda-df447f40db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf1a9f-7a8f-4262-9fd8-3724cee40674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf1a9f-7a8f-4262-9fd8-3724cee40674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dc93a6-bd5f-492e-9957-0c885307f48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:08Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86a98a3-b3f8-49ac-a3fc-b77bcbdfa5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86a98a3-b3f8-49ac-a3fc-b77bcbdfa5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b5005-cd2e-4af0-a925-f36dfdca8bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b5005-cd2e-4af0-a925-f36dfdca8bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3dc93a6-bd5f-492e-9957-0c885307f48e', 'volume_name': 'volume-f3dc93a6-bd5f-492e-9957-0c885307f48e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c17840c-2494-4fb9-b35d-0f8a205a7433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c17840c-2494-4fb9-b35d-0f8a205a7433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c33d0b-cb21-4c86-aa2a-bd5096267e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Volume f3dc93a6-bd5f-492e-9957-0c885307f48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3dc93a6-bd5f-492e-9957-0c885307f48e', 'volume_size': 1} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dc93a6-bd5f-492e-9957-0c885307f48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:08Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Creating volume f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:08 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:08 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e 1073741824 Aug 25 07:09:08 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Flow 'volume_create_manager' (bb0ffadd-e50e-49d9-a439-47b4a7999042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803bc77-4ecc-472b-b08d-afab9f2e987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803bc77-4ecc-472b-b08d-afab9f2e987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a24b437-2ff2-4e5f-98d8-8485c4dc66af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9431ac9406934b9fbafee9ba344b279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1dbce8e-489b-4811-9484-6deaac49732f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:08Z,use_quota=True,user_id='bbf5a88c2c004b6e9f3d1b20eae30081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac01b79b-7a08-40a4-9fa8-637b2eeacf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac01b79b-7a08-40a4-9fa8-637b2eeacf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a4164a-e64e-419b-9e1b-8c1f70ce6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a4164a-e64e-419b-9e1b-8c1f70ce6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a24b437-2ff2-4e5f-98d8-8485c4dc66af', 'volume_name': 'volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af', 'volume_size': 1, 'snapshot_id': 'f1dbce8e-489b-4811-9484-6deaac49732f'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029c0b07-e4d0-421f-8a47-8482386e6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029c0b07-e4d0-421f-8a47-8482386e6536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e911cb2-5b96-418c-adca-a27c3072402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:08 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Volume 8a24b437-2ff2-4e5f-98d8-8485c4dc66af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af', 'volume_size': 1, 'snapshot_id': 'f1dbce8e-489b-4811-9484-6deaac49732f'} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-87665381-824f-4a89-8750-631535826d00 tempest-ProjectAdminTests-1694486839 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:08 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e 1073741824" returned: 0 in 0.499s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:08 devstack sudo[115218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e Aug 25 07:09:08 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:08 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e" returned: 0 in 0.281s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.664s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" by "_create_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c33d0b-cb21-4c86-aa2a-bd5096267e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3dc93a6-bd5f-492e-9957-0c885307f48e', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc317312-9531-416b-986b-5e0f553e94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Creating volume 8a24b437-2ff2-4e5f-98d8-8485c4dc66af from snapshot f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" by "_copy_volume_from_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:09 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Volume volume-f3dc93a6-bd5f-492e-9957-0c885307f48e (f3dc93a6-bd5f-492e-9957-0c885307f48e): created successfully Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc317312-9531-416b-986b-5e0f553e94e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (d29c11cc-93f3-4adc-9fda-df447f40db0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] snapshot: f1dbce8e-489b-4811-9484-6deaac49732f, volume: 8a24b437-2ff2-4e5f-98d8-8485c4dc66af, {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:09:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-81aaeeee-82a5-42a5-8433-80e18e83ebb2 tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[242583cd-6be0-476b-b59a-6eb36d08ec25]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:09 devstack sudo[115221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:09 devstack sudo[115221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:09 devstack sudo[115221]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.414s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d309cae2-84d3-4a6d-8e06-8da0543123fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e7692-7cf3-4196-8ec2-ac5635c33b7f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:09 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:09 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:09 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.428s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Creating direct copy from snapshot {{(pid=94487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG cinder.utils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Path /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af not found in is_blk_device check {{(pid=94487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:10 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af Aug 25 07:09:10 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:15 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" returned: 0 in 5.031s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.image.image_utils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af {{(pid=94487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:09:15 devstack cinder-volume[94487]: INFO cinder.image.image_utils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Converted 1024.00 MB image at 203.50 MB/s Aug 25 07:09:15 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af is being set with open permissions: ugo+rw Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:15 devstack sudo[115246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af Aug 25 07:09:15 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:15 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" returned: 0 in 0.251s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" released by "_copy_volume_from_snapshot" :: held 6.221s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" released by "_create_volume_from_snapshot" :: held 6.307s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.348s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.923s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Creating offline snapshot 2fc7234e-9728-47f2-b058-b3ac375e2ea8 of volume 9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e911cb2-5b96-418c-adca-a27c3072402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af', 'volume_size': 1, 'snapshot_id': 'f1dbce8e-489b-4811-9484-6deaac49732f'}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93abc4-a7dc-4b27-ad9c-f221af479c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5356cf-508a-409f-84cc-7838465086d8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:15 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Volume volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af (8a24b437-2ff2-4e5f-98d8-8485c4dc66af): created successfully Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93abc4-a7dc-4b27-ad9c-f221af479c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Flow 'volume_create_manager' (bb0ffadd-e50e-49d9-a439-47b4a7999042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d5728419-d5ff-4ee5-b66d-59e6b3f88278 tempest-SnapshotDependencyTests-467385890 None] Created volume successfully. Aug 25 07:09:15 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 Aug 25 07:09:15 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:15 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588" returned: 0 in 0.455s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:15 devstack sudo[115254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 1G Aug 25 07:09:15 devstack sudo[115254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-f1dbce8e-489b-4811-9484-6deaac49732f-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-f1dbce8e-489b-4811-9484-6deaac49732f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Deleting offline snapshot f1dbce8e-489b-4811-9484-6deaac49732f of volume d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] snapshot_file for this snap is: volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[df50d603-739b-4dc0-88f7-d6271018daed]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:16 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:16 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:16 devstack sudo[115254]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 1G" returned: 0 in 0.520s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c97f9f2-acd6-4767-8575-5266837d1588 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:16 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c97f9f2-acd6-4767-8575-5266837d1588 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 Aug 25 07:09:16 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:16 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.443s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d309cae2-84d3-4a6d-8e06-8da0543123fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a3fcc-77f9-4ba0-a2b8-3ad2812b27dc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:16 devstack sudo[115269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:16 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:16 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c97f9f2-acd6-4767-8575-5266837d1588 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8" returned: 0 in 0.354s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:16 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 is being set with open permissions: ugo+rw Aug 25 07:09:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:16 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 Aug 25 07:09:16 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:17 devstack sudo[115279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info Aug 25 07:09:17 devstack sudo[115279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.682s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:17 devstack sudo[115282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:17 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack sudo[115279]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info" returned: 0 in 0.296s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info is being set with open permissions: ugo+rw Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:17 devstack sudo[115285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info Aug 25 07:09:17 devstack sudo[115285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.398s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:17 devstack sudo[115291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f Aug 25 07:09:17 devstack sudo[115291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack sudo[115285]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.info" returned: 0 in 0.284s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.514s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 3da0fa53-e921-4ce6-8be2-c95ae7070e78 of volume f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-14fd71bd-4db9-48fe-97d7-665403558e54 tempest-ProjectReaderTests-139380445 None] Create snapshot completed successfully Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f9eb6-7317-4112-86ef-dfe5f4c6d506]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:17 devstack sudo[115291]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa.f1dbce8e-489b-4811-9484-6deaac49732f" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:17 devstack sudo[115293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e Aug 25 07:09:17 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-f1dbce8e-489b-4811-9484-6deaac49732f" released by "_delete_snapshot" :: held 1.935s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" released by "delete_snapshot" :: held 1.968s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Created reservations ['b8e65a70-f54f-4a3a-9a5a-3ecbaa6960ff', '120d72b0-5c6b-4147-8c02-d9ecab36c454', '9867f6a2-47e7-4d93-9fd5-e7464ed8f83a', '766830c3-781d-4cce-b540-422b69935e45'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-2fc7234e-9728-47f2-b058-b3ac375e2ea8-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-2fc7234e-9728-47f2-b058-b3ac375e2ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-2fc7234e-9728-47f2-b058-b3ac375e2ea8" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-2fc7234e-9728-47f2-b058-b3ac375e2ea8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Deleting offline snapshot 2fc7234e-9728-47f2-b058-b3ac375e2ea8 of volume 9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] snapshot_file for this snap is: volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:18 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[58964b94-3613-4038-a50e-17ecf97fa686]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Delete snapshot completed successfully. Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e" returned: 0 in 0.481s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-194f789f-93d7-47e4-a26e-11bea231cc03 tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-f1dbce8e-489b-4811-9484-6deaac49732f-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:18 devstack sudo[115300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 1G Aug 25 07:09:18 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:18 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 Aug 25 07:09:18 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:18 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8" returned: 0 in 0.415s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c97f9f2-acd6-4767-8575-5266837d1588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea83f32-0112-4977-af3c-4d6818cbb252]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:18 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 1G" returned: 0 in 0.487s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dc93a6-bd5f-492e-9957-0c885307f48e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:18 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dc93a6-bd5f-492e-9957-0c885307f48e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 Aug 25 07:09:18 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:18 devstack sudo[115312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 Aug 25 07:09:18 devstack sudo[115312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dc93a6-bd5f-492e-9957-0c885307f48e -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78" returned: 0 in 0.346s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 is being set with open permissions: ugo+rw Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115312]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588" returned: 0 in 0.420s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 Aug 25 07:09:19 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 Aug 25 07:09:19 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-d309cae2-84d3-4a6d-8e06-8da0543123fa-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-d309cae2-84d3-4a6d-8e06-8da0543123fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[534567d2-285e-4369-86bc-1d1e7cdcc0b6]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78" returned: 0 in 0.347s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info Aug 25 07:09:19 devstack sudo[115332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:19 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8" returned: 0 in 0.464s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8 Aug 25 07:09:19 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115332]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info" returned: 0 in 0.349s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info is being set with open permissions: ugo+rw Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.452s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info Aug 25 07:09:19 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588.2fc7234e-9728-47f2-b058-b3ac375e2ea8" returned: 0 in 0.326s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack sudo[115344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa Aug 25 07:09:19 devstack sudo[115344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-2fc7234e-9728-47f2-b058-b3ac375e2ea8" released by "_delete_snapshot" :: held 1.763s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" released by "delete_snapshot" :: held 1.802s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Created reservations ['2ff25c0f-89a9-48db-a060-23ad8fa944d4', '1e44aa0f-73b9-40b9-b550-662e40e75b05', 'ce93b7b6-bd70-4535-b777-5fde9a0ffdb9', '5fa106ee-8684-4b9d-839c-d87f4bce5c23'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Delete snapshot completed successfully. Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b00be292-d494-4ea2-845c-35872d80ff8a tempest-ProjectReaderTests-139380445 None] Lock "cinder-2fc7234e-9728-47f2-b058-b3ac375e2ea8-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:20 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.info" returned: 0 in 0.346s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:20 devstack sudo[115344]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d309cae2-84d3-4a6d-8e06-8da0543123fa" returned: 0 in 0.338s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-d309cae2-84d3-4a6d-8e06-8da0543123fa" released by "delete_volume" :: held 0.877s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-bf9aadaa-05c4-4e35-abf2-b331377b8c64 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-9c97f9f2-acd6-4767-8575-5266837d1588-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Created reservations ['0c42a37b-d44e-487f-84b2-762657640a7f', '3240f216-e520-4046-bb33-1e6bb272f5b7', '1f48c391-019d-434a-8ee9-7321684fd904', '549c7ecf-ca9d-472d-8ea9-5e5b07500973'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "cinder-9c97f9f2-acd6-4767-8575-5266837d1588-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8144935-9b8f-4b54-a944-7000490d6880]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-8a24b437-2ff2-4e5f-98d8-8485c4dc66af-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-8a24b437-2ff2-4e5f-98d8-8485c4dc66af-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack sudo[115349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:20 devstack sudo[115349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:20 devstack sudo[115348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 Aug 25 07:09:20 devstack sudo[115348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" acquired by "delete_volume" :: waited 0.027s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cca9d3-40f7-4222-9291-33227cdfc63a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack sudo[115352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af Aug 25 07:09:20 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:20 devstack sudo[115349]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:20 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Deleted volume successfully. Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ab31315c-b41f-4518-8532-224d89d35dde tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-d309cae2-84d3-4a6d-8e06-8da0543123fa-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:20 devstack sudo[115348]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588" returned: 0 in 0.508s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-3da0fa53-e921-4ce6-8be2-c95ae7070e78-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:21 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588 Aug 25 07:09:21 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-3da0fa53-e921-4ce6-8be2-c95ae7070e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-3da0fa53-e921-4ce6-8be2-c95ae7070e78" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-3da0fa53-e921-4ce6-8be2-c95ae7070e78" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 3da0fa53-e921-4ce6-8be2-c95ae7070e78 of volume f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fff9a30-5be6-4eba-9cda-8a24492ea4c7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" returned: 0 in 0.537s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af Aug 25 07:09:21 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 Aug 25 07:09:21 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9c97f9f2-acd6-4767-8575-5266837d1588" returned: 0 in 0.358s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9c97f9f2-acd6-4767-8575-5266837d1588" released by "delete_volume" :: held 0.957s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Created reservations ['d3e3a4b4-04e8-4983-b576-644dc596b306', '4820aeab-4c00-4c8b-a6bd-314bb0ea4269', '0e26924a-1fd9-4d67-bf85-5fe933e82611', 'a1267a55-9086-4e96-9425-85b2d4517b16'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:21 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" returned: 0 in 0.379s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-quobyte-8a24b437-2ff2-4e5f-98d8-8485c4dc66af" released by "delete_volume" :: held 0.962s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Created reservations ['47e95f8f-3676-40b0-9278-bfa053a4a71c', 'ba558c7d-eada-489f-b424-23e057ec7a77', 'edbef0c6-eefc-45be-b4bf-ff1c353cf1db', '284e351b-2831-4b4e-98fb-8c03b320de39'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:21 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78" returned: 0 in 0.553s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3dc93a6-bd5f-492e-9957-0c885307f48e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb20b04-df13-4852-be53-1677f93ddf3d]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:21 devstack sudo[115374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e Aug 25 07:09:21 devstack sudo[115374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Deleted volume successfully. Aug 25 07:09:21 devstack sudo[115376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:21 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8a505fae-dd1c-4ac2-970f-edd6f5ebe378 tempest-ProjectReaderTests-139380445 None] Lock "cinder-9c97f9f2-acd6-4767-8575-5266837d1588-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:22 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.304s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Deleted volume successfully. Aug 25 07:09:22 devstack sudo[115374]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e" returned: 0 in 0.465s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b4d116e3-4560-451e-b8fd-88cb58cba97d tempest-SnapshotDependencyTests-467385890 None] Lock "cinder-8a24b437-2ff2-4e5f-98d8-8485c4dc66af-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:22 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 Aug 25 07:09:22 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:22 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78" returned: 0 in 0.417s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:22 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78 Aug 25 07:09:22 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:22 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e.3da0fa53-e921-4ce6-8be2-c95ae7070e78" returned: 0 in 0.332s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-3da0fa53-e921-4ce6-8be2-c95ae7070e78" released by "_delete_snapshot" :: held 1.925s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" released by "delete_snapshot" :: held 1.990s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Created reservations ['d99859b6-22b8-4887-b1d7-293eed55526a', '9b120737-0eb3-4b84-aa80-b7b3e557e44d', '9973b80c-295d-4913-a359-05f502367ba4', '3dd1bc5c-6198-492b-9aee-932d3be359d7'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (12ac5f8f-f4f1-4e21-97d9-99b816c0b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421a2141-379d-493d-b2c2-ace3e6828e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421a2141-379d-493d-b2c2-ace3e6828e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019021630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cf1c55-b738-4151-aed4-8d50b0ae6cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:23Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cf4cb8-c670-4938-bf92-fd99a3fbdaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cf4cb8-c670-4938-bf92-fd99a3fbdaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e27a88c-059e-4341-b172-0818f4688b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e27a88c-059e-4341-b172-0818f4688b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cf1c55-b738-4151-aed4-8d50b0ae6cbb', 'volume_name': 'volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41fabfd-dc37-4543-a744-1c458cc9eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41fabfd-dc37-4543-a744-1c458cc9eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1655fe5-87d1-4d12-9c6c-ab15dbaf439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Volume e0cf1c55-b738-4151-aed4-8d50b0ae6cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb', 'volume_size': 1} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019021630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cf1c55-b738-4151-aed4-8d50b0ae6cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:23Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Creating volume e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:23 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-45de413f-aad6-490f-ae3c-eee604aea855 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-3da0fa53-e921-4ce6-8be2-c95ae7070e78-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:23 devstack sudo[115392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb 1073741824 Aug 25 07:09:23 devstack sudo[115392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:23 devstack sudo[115392]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb 1073741824" returned: 0 in 0.539s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:23 devstack sudo[115397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb Aug 25 07:09:23 devstack sudo[115397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:24 devstack sudo[115397]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" returned: 0 in 0.271s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-f3dc93a6-bd5f-492e-9957-0c885307f48e-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1655fe5-87d1-4d12-9c6c-ab15dbaf439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f19f0-0cb0-4599-821d-bde5b93cc5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f3dc93a6-bd5f-492e-9957-0c885307f48e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:24 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Volume volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb (e0cf1c55-b738-4151-aed4-8d50b0ae6cbb): created successfully Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f19f0-0cb0-4599-821d-bde5b93cc5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (12ac5f8f-f4f1-4e21-97d9-99b816c0b801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:24 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b4b4305c-49f0-40c0-9cd0-89ab5cb7c8ab tempest-ProjectReaderTests-139380445 None] Created volume successfully. Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1233852-28c8-49cb-ae3d-361be9be70d3]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:24 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e Aug 25 07:09:24 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:24 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:24 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e Aug 25 07:09:24 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:24 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f3dc93a6-bd5f-492e-9957-0c885307f48e" returned: 0 in 0.249s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-f3dc93a6-bd5f-492e-9957-0c885307f48e" released by "delete_volume" :: held 0.685s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Created reservations ['90a1c8ca-545f-4efe-ad61-a27d6ae5df61', '053672fa-7734-4d26-91b6-a9edcd4498ba', 'bedc4454-626c-4871-955f-dd5e058ec8e6', '79e5bcfd-38bb-4b12-9ab9-1c2f7a8b7f28'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:25 devstack sudo[115409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:25 devstack sudo[115409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:25 devstack sudo[115409]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.285s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-0a802e7f-db31-4c36-b160-d71489fccb0f tempest-ProjectMemberTests-1254747993 None] Lock "cinder-f3dc93a6-bd5f-492e-9957-0c885307f48e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Creating offline snapshot 3bdb92ff-9db3-456e-b77c-2a63407a2d0f of volume e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[af550b7d-d34a-48b4-b99d-dc04c7404d4a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:25 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb Aug 25 07:09:25 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:25 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:25 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (2938c0c2-40f4-4d53-916b-4ec2022e7540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a1e05-1486-4cf9-97e4-2538f5a32c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" returned: 0 in 0.545s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a1e05-1486-4cf9-97e4-2538f5a32c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624687275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5a71d7-a451-4df7-b8d6-a07c04f9dc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:26Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:26 devstack sudo[115418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f 1G Aug 25 07:09:26 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb7dba-fdda-4055-9071-454803fc4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb7dba-fdda-4055-9071-454803fc4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c34a78-1573-4a5f-8877-0aac5bc84175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c34a78-1573-4a5f-8877-0aac5bc84175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5a71d7-a451-4df7-b8d6-a07c04f9dc41', 'volume_name': 'volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d21c85-8836-4981-8cca-9b66ba25a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d21c85-8836-4981-8cca-9b66ba25a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776be097-1e85-46a4-bf24-19ae6b40a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:26 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Volume 5e5a71d7-a451-4df7-b8d6-a07c04f9dc41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41', 'volume_size': 1} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:26 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f 1G" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:26 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f Aug 25 07:09:26 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:26 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f" returned: 0 in 0.317s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:26 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f is being set with open permissions: ugo+rw Aug 25 07:09:26 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:26 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f Aug 25 07:09:26 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:27 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f" returned: 0 in 0.324s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:27 devstack sudo[115433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info Aug 25 07:09:27 devstack sudo[115433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:27 devstack sudo[115433]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:27 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info is being set with open permissions: ugo+rw Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:27 devstack sudo[115436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info Aug 25 07:09:27 devstack sudo[115436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:27 devstack sudo[115436]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.info" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.627s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624687275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5a71d7-a451-4df7-b8d6-a07c04f9dc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:26Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Creating volume 5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:27 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:27 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:27 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 1073741824 Aug 25 07:09:27 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:27 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-653dc4f2-b4ae-4769-9022-f197fbdb0bf4 tempest-ProjectReaderTests-139380445 None] Create snapshot completed successfully Aug 25 07:09:28 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 1073741824" returned: 0 in 0.544s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:28 devstack sudo[115445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 Aug 25 07:09:28 devstack sudo[115445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-3bdb92ff-9db3-456e-b77c-2a63407a2d0f-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-3bdb92ff-9db3-456e-b77c-2a63407a2d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:28 devstack sudo[115445]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" returned: 0 in 0.343s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-3bdb92ff-9db3-456e-b77c-2a63407a2d0f" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776be097-1e85-46a4-bf24-19ae6b40a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09683c2-9a99-417a-99b2-585c58dedbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-3bdb92ff-9db3-456e-b77c-2a63407a2d0f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Deleting offline snapshot 3bdb92ff-9db3-456e-b77c-2a63407a2d0f of volume e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] snapshot_file for this snap is: volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:28 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Volume volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 (5e5a71d7-a451-4df7-b8d6-a07c04f9dc41): created successfully Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09683c2-9a99-417a-99b2-585c58dedbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (2938c0c2-40f4-4d53-916b-4ec2022e7540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[713456a5-4f80-49df-bb97-639d50969782]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:28 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:28 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-af1dbc86-5532-4e89-9478-9ac45c412bbd tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:09:28 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f Aug 25 07:09:28 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:29 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f" returned: 0 in 0.388s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc92cb3-74d1-46f9-b83b-638937ecd127]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:29 devstack sudo[115457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb Aug 25 07:09:29 devstack sudo[115457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 0edb5bb8-01a8-4207-930c-94cae4747218 of volume 5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0c67c2-8447-4a56-a058-421e3fe3ae87]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:29 devstack sudo[115459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 Aug 25 07:09:29 devstack sudo[115459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:29 devstack sudo[115457]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" returned: 0 in 0.439s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:29 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f Aug 25 07:09:29 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:29 devstack sudo[115459]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" returned: 0 in 0.449s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:29 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:29 devstack sudo[115470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 1G Aug 25 07:09:29 devstack sudo[115470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:30 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f" returned: 0 in 0.404s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:30 devstack sudo[115476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f Aug 25 07:09:30 devstack sudo[115476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:30 devstack sudo[115470]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 1G" returned: 0 in 0.425s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:30 devstack sudo[115482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 Aug 25 07:09:30 devstack sudo[115482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:30 devstack sudo[115476]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb.3bdb92ff-9db3-456e-b77c-2a63407a2d0f" returned: 0 in 0.296s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-3bdb92ff-9db3-456e-b77c-2a63407a2d0f" released by "_delete_snapshot" :: held 1.646s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" released by "delete_snapshot" :: held 1.699s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Created reservations ['51ec68b1-335e-4b80-badc-ad42308564cb', '8fc25f9b-7ad7-4cdb-82be-2f3fb54e20a1', 'a533ad9d-3d21-4525-aad7-cf7d91a48071', 'bdbcef01-3315-422b-adc3-621b13189360'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:30 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Delete snapshot completed successfully. Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-662e8104-511d-4095-a9eb-fe079698c6cf tempest-ProjectReaderTests-139380445 None] Lock "cinder-3bdb92ff-9db3-456e-b77c-2a63407a2d0f-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:30 devstack sudo[115482]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218" returned: 0 in 0.300s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:30 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 is being set with open permissions: ugo+rw Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:30 devstack sudo[115487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 Aug 25 07:09:30 devstack sudo[115487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "cinder-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:30 devstack sudo[115487]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" acquired by "delete_volume" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be2ebd-c833-4c6f-b4ab-01382fd257e7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:30 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:30 devstack sudo[115490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info Aug 25 07:09:30 devstack sudo[115490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:31 devstack sudo[115491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb Aug 25 07:09:31 devstack sudo[115491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:31 devstack sudo[115490]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info" returned: 0 in 0.276s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:31 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info is being set with open permissions: ugo+rw Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:31 devstack sudo[115495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info Aug 25 07:09:31 devstack sudo[115495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:31 devstack sudo[115491]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" returned: 0 in 0.396s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:31 devstack sudo[115500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb Aug 25 07:09:31 devstack sudo[115500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:31 devstack sudo[115495]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.info" returned: 0 in 0.323s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:31 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d8e5fa0c-7344-431f-bde8-e6a50802cde1 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:31 devstack sudo[115500]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" returned: 0 in 0.337s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb" released by "delete_volume" :: held 0.809s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Created reservations ['e9b4f77e-5417-4a69-b907-95af71064f38', 'f75a921a-0efe-408f-bf7f-439e1d40b3eb', 'cf6b4269-958d-479c-905f-761b65e97093', '99596b72-b676-4289-a93c-d7a5f5a17a10'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:31 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:31 devstack sudo[115505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:31 devstack sudo[115505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:32 devstack sudo[115505]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:32 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Deleted volume successfully. Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-15e0f357-135a-4bf6-a3af-114f059852ff tempest-ProjectReaderTests-139380445 None] Lock "cinder-e0cf1c55-b738-4151-aed4-8d50b0ae6cbb-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (a84904bb-091e-4b6a-917d-a055466d5dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c272787a-428a-4ac7-b886-e5c165c91f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c272787a-428a-4ac7-b886-e5c165c91f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618692761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b00797-cd1a-487b-a74e-744e3934ad8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:32Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e4b64c-c8dd-4fd3-a61d-cd6fb1fab779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e4b64c-c8dd-4fd3-a61d-cd6fb1fab779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d847a-a713-4d29-a8d8-3ac9d973631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d847a-a713-4d29-a8d8-3ac9d973631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b00797-cd1a-487b-a74e-744e3934ad8f', 'volume_name': 'volume-d0b00797-cd1a-487b-a74e-744e3934ad8f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47269b3-5a7b-4477-a32d-b3d0dddad9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47269b3-5a7b-4477-a32d-b3d0dddad9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5846d4-d82c-4ba1-a3dc-c5923bd9be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:32 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Volume d0b00797-cd1a-487b-a74e-744e3934ad8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b00797-cd1a-487b-a74e-744e3934ad8f', 'volume_size': 1} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618692761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b00797-cd1a-487b-a74e-744e3934ad8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:32Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Creating volume d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:32 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-0edb5bb8-01a8-4207-930c-94cae4747218-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:32 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f 1073741824 Aug 25 07:09:32 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-0edb5bb8-01a8-4207-930c-94cae4747218-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-0edb5bb8-01a8-4207-930c-94cae4747218" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-0edb5bb8-01a8-4207-930c-94cae4747218" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 0edb5bb8-01a8-4207-930c-94cae4747218 of volume 5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[27774791-a3f2-4863-842a-95efda02535a]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:32 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:32 devstack sudo[115510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 Aug 25 07:09:32 devstack sudo[115510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:33 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f 1073741824" returned: 0 in 0.547s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:33 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f Aug 25 07:09:33 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:33 devstack sudo[115510]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218" returned: 0 in 0.437s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c756c70-b6c6-4df1-b78f-67631e9f41b0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:33 devstack sudo[115522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 Aug 25 07:09:33 devstack sudo[115522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:33 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f" returned: 0 in 0.307s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5846d4-d82c-4ba1-a3dc-c5923bd9be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b00797-cd1a-487b-a74e-744e3934ad8f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c629902-10cf-4f07-84b7-d4038b078550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:33 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Volume volume-d0b00797-cd1a-487b-a74e-744e3934ad8f (d0b00797-cd1a-487b-a74e-744e3934ad8f): created successfully Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c629902-10cf-4f07-84b7-d4038b078550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (a84904bb-091e-4b6a-917d-a055466d5dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:33 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-362efd92-559b-4949-985f-0e800c1bbb2e tempest-ProjectReaderTests-139380445 None] Created volume successfully. Aug 25 07:09:33 devstack sudo[115522]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" returned: 0 in 0.486s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:33 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:33 devstack sudo[115529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 Aug 25 07:09:33 devstack sudo[115529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:34 devstack sudo[115529]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218" returned: 0 in 0.385s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:34 devstack sudo[115535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218 Aug 25 07:09:34 devstack sudo[115535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:34 devstack sudo[115535]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41.0edb5bb8-01a8-4207-930c-94cae4747218" returned: 0 in 0.299s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-0edb5bb8-01a8-4207-930c-94cae4747218" released by "_delete_snapshot" :: held 1.734s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" released by "delete_snapshot" :: held 1.789s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Created reservations ['268df4f9-a4ed-4917-b99c-fa7efe9ed4b1', '40a5df47-6b88-4267-8ffe-6bd4557328e6', '3f23d829-02a2-474c-a331-3610fa46ba50', '949babf1-5b9e-40a9-8199-3d29116eaa43'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:34 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-a13eb829-11ce-481a-b35e-f3ac08bd55c7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-0edb5bb8-01a8-4207-930c-94cae4747218-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Creating offline snapshot 65184a55-6d76-4778-9623-1086883946ce of volume d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[220c3a15-9e33-44d7-bd90-69f927e28c16]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:34 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" acquired by "delete_volume" :: waited 0.021s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4710ba1-7194-4fcf-86c3-6255347aeea2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:35 devstack sudo[115538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f Aug 25 07:09:35 devstack sudo[115538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:35 devstack sudo[115539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 Aug 25 07:09:35 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:35 devstack sudo[115538]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f" returned: 0 in 0.406s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:35 devstack sudo[115547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce 1G Aug 25 07:09:35 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:35 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" returned: 0 in 0.424s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:35 devstack sudo[115550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41 Aug 25 07:09:35 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:35 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41" released by "delete_volume" :: held 0.780s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Created reservations ['5d231c45-4732-444b-8fe8-886d7a6b9d4b', 'bff93377-19e7-4e86-8228-ebf0c088263b', 'd0f93f6e-b66d-4907-9a81-cc5d5abdbe89', 'bd414afe-e5e8-4a03-adba-214a9af7cf8b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:35 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce 1G" returned: 0 in 0.516s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b00797-cd1a-487b-a74e-744e3934ad8f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:35 devstack sudo[115557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b00797-cd1a-487b-a74e-744e3934ad8f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce Aug 25 07:09:35 devstack sudo[115557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:35 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:36 devstack sudo[115559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:36 devstack sudo[115559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:36 devstack sudo[115557]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b00797-cd1a-487b-a74e-744e3934ad8f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce" returned: 0 in 0.389s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:36 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce is being set with open permissions: ugo+rw Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:36 devstack sudo[115559]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.322s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:36 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:09:36 devstack sudo[115566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce Aug 25 07:09:36 devstack sudo[115566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8ba790c6-64e9-4492-9152-191ef2724eb3 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-5e5a71d7-a451-4df7-b8d6-a07c04f9dc41-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:36 devstack sudo[115566]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce" returned: 0 in 0.268s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (c87c02b5-db3a-4003-a5c9-1e636f14ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91783f6-cdc1-4953-847e-fb23ee478338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91783f6-cdc1-4953-847e-fb23ee478338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094884687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c57c3d-e9fd-413f-b317-abbb1bfbed5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:36Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27af8d3-36fb-4e21-b9e4-88f6c668fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27af8d3-36fb-4e21-b9e4-88f6c668fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2944a451-f229-4769-8e8b-49cebc394b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2944a451-f229-4769-8e8b-49cebc394b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c57c3d-e9fd-413f-b317-abbb1bfbed5f', 'volume_name': 'volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f016c020-e583-4fe1-812a-e66ad6245dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f016c020-e583-4fe1-812a-e66ad6245dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db45a5-78f9-4d20-b891-d72e50bb1b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:36 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Volume 95c57c3d-e9fd-413f-b317-abbb1bfbed5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f', 'volume_size': 1} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:36 devstack sudo[115569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info Aug 25 07:09:36 devstack sudo[115569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:36 devstack sudo[115569]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:36 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info is being set with open permissions: ugo+rw Aug 25 07:09:36 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:36 devstack sudo[115572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info Aug 25 07:09:36 devstack sudo[115572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:37 devstack sudo[115572]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.info" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094884687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c57c3d-e9fd-413f-b317-abbb1bfbed5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:36Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Creating volume 95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:37 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:37 devstack sudo[115575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f 1073741824 Aug 25 07:09:37 devstack sudo[115575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4646680a-fe48-4a5b-b8c6-0c38ba3d67c7 tempest-ProjectReaderTests-139380445 None] Create snapshot completed successfully Aug 25 07:09:37 devstack sudo[115575]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f 1073741824" returned: 0 in 0.422s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:37 devstack sudo[115580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f Aug 25 07:09:37 devstack sudo[115580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:37 devstack sudo[115580]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" returned: 0 in 0.254s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db45a5-78f9-4d20-b891-d72e50bb1b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006e0604-45a4-41a4-9626-0ad7b1461f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:37 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Volume volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f (95c57c3d-e9fd-413f-b317-abbb1bfbed5f): created successfully Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006e0604-45a4-41a4-9626-0ad7b1461f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:37 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (c87c02b5-db3a-4003-a5c9-1e636f14ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:37 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-08322162-c1fd-4e04-8935-b65f65144c3b tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-65184a55-6d76-4778-9623-1086883946ce-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-65184a55-6d76-4778-9623-1086883946ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-65184a55-6d76-4778-9623-1086883946ce" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-65184a55-6d76-4778-9623-1086883946ce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Deleting offline snapshot 65184a55-6d76-4778-9623-1086883946ce of volume d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] snapshot_file for this snap is: volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f039ed-8b52-4e1b-aeb0-35ac4bd4cc24]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:38 devstack sudo[115584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce Aug 25 07:09:38 devstack sudo[115584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:38 devstack sudo[115584]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce" returned: 0 in 0.348s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0b00797-cd1a-487b-a74e-744e3934ad8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689e283-0a81-4063-bc53-b92a06f290f4]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:38 devstack sudo[115589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f Aug 25 07:09:38 devstack sudo[115589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 of volume 95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[22605c30-3a85-4165-9820-8aee71b38624]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:38 devstack sudo[115589]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:38 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:38 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce Aug 25 07:09:38 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:38 devstack sudo[115593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f Aug 25 07:09:38 devstack sudo[115593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:39 devstack sudo[115593]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" returned: 0 in 0.372s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:39 devstack sudo[115606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 1G Aug 25 07:09:39 devstack sudo[115606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:39 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce" returned: 0 in 0.341s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:39 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce Aug 25 07:09:39 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:39 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f.65184a55-6d76-4778-9623-1086883946ce" returned: 0 in 0.243s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-65184a55-6d76-4778-9623-1086883946ce" released by "_delete_snapshot" :: held 1.411s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" released by "delete_snapshot" :: held 1.435s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Created reservations ['c596f9cc-98ac-4c51-8193-bbe1da672de5', 'ae91ffa1-5c72-4565-88d6-7e53ff0c6bc0', 'a0e8cbe1-78cd-417d-ac84-d3ba6f6299e1', '26bd2aa5-4d89-4683-92ab-944ff574dbc0'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:39 devstack sudo[115606]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 1G" returned: 0 in 0.419s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:39 devstack sudo[115615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 Aug 25 07:09:39 devstack sudo[115615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:39 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Delete snapshot completed successfully. Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-6d017f42-dc1f-4473-ac79-dab1355a3dbe tempest-ProjectReaderTests-139380445 None] Lock "cinder-65184a55-6d76-4778-9623-1086883946ce-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:39 devstack sudo[115615]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" returned: 0 in 0.307s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:39 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 is being set with open permissions: ugo+rw Aug 25 07:09:39 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:39 devstack sudo[115620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 Aug 25 07:09:39 devstack sudo[115620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:40 devstack sudo[115620]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" returned: 0 in 0.248s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-d0b00797-cd1a-487b-a74e-744e3934ad8f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:40 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info Aug 25 07:09:40 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "cinder-d0b00797-cd1a-487b-a74e-744e3934ad8f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa3a1e-67be-4f5d-a2f4-2f318509897f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:40 devstack sudo[115625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f Aug 25 07:09:40 devstack sudo[115625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:40 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info" returned: 0 in 0.283s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:40 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info is being set with open permissions: ugo+rw Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:40 devstack sudo[115628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info Aug 25 07:09:40 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:40 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.info" returned: 0 in 0.251s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:40 devstack sudo[115625]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f" returned: 0 in 0.425s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:40 devstack sudo[115634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f Aug 25 07:09:40 devstack sudo[115634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:40 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c62c413a-3fdf-4a33-ad95-1d4d6ad427cb tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:40 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 of volume 95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a477d6a5-ad3e-4be5-b110-85d5feec0722]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:41 devstack sudo[115634]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-d0b00797-cd1a-487b-a74e-744e3934ad8f" returned: 0 in 0.291s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-d0b00797-cd1a-487b-a74e-744e3934ad8f" released by "delete_volume" :: held 0.773s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Created reservations ['1649f77f-4434-41d4-84fe-0158c590ea60', '66a8995e-8d8a-4650-b824-82bdc8f9f6bc', '05c28b65-8500-4ab0-88dd-c002dab289b7', '842103d3-32cf-4a3a-89e7-a138ebf860f3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:41 devstack sudo[115637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 Aug 25 07:09:41 devstack sudo[115637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:41 devstack sudo[115639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:41 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:41 devstack sudo[115637]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" returned: 0 in 0.392s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1caed-22a6-4f33-b713-8428fcc8da63]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:41 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.289s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:41 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Deleted volume successfully. Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-ffff2214-4cfc-44d2-97cc-60ca74d69dba tempest-ProjectReaderTests-139380445 None] Lock "cinder-d0b00797-cd1a-487b-a74e-744e3934ad8f-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:41 devstack sudo[115645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f Aug 25 07:09:41 devstack sudo[115645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:41 devstack sudo[115645]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" returned: 0 in 0.376s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:41 devstack sudo[115650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 Aug 25 07:09:41 devstack sudo[115650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (3886520e-6670-4803-89ad-4ede27751530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6598896-e557-40f6-be95-3a084d29a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6598896-e557-40f6-be95-3a084d29a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172137431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d83e1-bf55-4795-9dd2-81a70abd7c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:42Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f15a2c-1b0a-4be9-9f9f-c5676b0e7f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f15a2c-1b0a-4be9-9f9f-c5676b0e7f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4979de89-2e04-4b43-a5be-c953b36baaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4979de89-2e04-4b43-a5be-c953b36baaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9d83e1-bf55-4795-9dd2-81a70abd7c33', 'volume_name': 'volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8cd27-a0b6-4acf-b39b-f23101204759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8cd27-a0b6-4acf-b39b-f23101204759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2542b18f-23f4-4a21-b5d8-4ad08f606bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:41 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Volume 9e9d83e1-bf55-4795-9dd2-81a70abd7c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33', 'volume_size': 1} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172137431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d83e1-bf55-4795-9dd2-81a70abd7c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d68c470396e4659b5bf7509a7b2ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:42Z,use_quota=True,user_id='64a93089cac7488085fde4cc63f1c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Creating volume 9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:41 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:41 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:42 devstack sudo[115652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 1073741824 Aug 25 07:09:42 devstack sudo[115652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:42 devstack sudo[115650]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" returned: 0 in 0.345s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:42 devstack sudo[115657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3 Aug 25 07:09:42 devstack sudo[115657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:42 devstack sudo[115652]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 1073741824" returned: 0 in 0.430s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:42 devstack sudo[115657]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f.745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" returned: 0 in 0.281s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:42 devstack sudo[115663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 Aug 25 07:09:42 devstack sudo[115663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3" released by "_delete_snapshot" :: held 1.503s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" released by "delete_snapshot" :: held 1.522s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Created reservations ['82fa1920-690f-4e09-9b8f-cea18f7f03be', '87b83b69-9ebd-43f4-8c4f-c3122870e838', '5ba71f79-500b-42c7-bd10-d6681bc5e0cb', 'b692e69a-c245-4d69-9ccc-a3232dcb4c2d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-79c14d9c-ddf5-4965-8150-b887b2cc694a tempest-ProjectMemberTests-1254747993 None] Lock "cinder-745da64a-c3c9-4eb2-bee0-db40f4c3c9f3-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:42 devstack sudo[115663]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" returned: 0 in 0.257s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2542b18f-23f4-4a21-b5d8-4ad08f606bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0c61c0-393d-4337-9edc-cde4d4363f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:42 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Volume volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 (9e9d83e1-bf55-4795-9dd2-81a70abd7c33): created successfully Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0c61c0-393d-4337-9edc-cde4d4363f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:42 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Flow 'volume_create_manager' (3886520e-6670-4803-89ad-4ede27751530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:42 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-1f9f63c4-3f37-440d-9278-e0c74d6266eb tempest-ProjectReaderTests-139380445 None] Created volume successfully. Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Creating offline snapshot 33e4ab43-16cd-4e04-9e68-722aaa566245 of volume 9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016ec22-1b8e-404a-9456-948cd95f2a43]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-95c57c3d-e9fd-413f-b317-abbb1bfbed5f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-95c57c3d-e9fd-413f-b317-abbb1bfbed5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:43 devstack sudo[115666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 Aug 25 07:09:43 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d073e528-498d-400d-9177-42cefce4e09f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:43 devstack sudo[115668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f Aug 25 07:09:43 devstack sudo[115668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:43 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" returned: 0 in 0.380s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:43 devstack sudo[115673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 1G Aug 25 07:09:43 devstack sudo[115673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:43 devstack sudo[115668]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" returned: 0 in 0.374s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:43 devstack sudo[115678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f Aug 25 07:09:43 devstack sudo[115678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:43 devstack sudo[115673]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 1G" returned: 0 in 0.434s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:43 devstack sudo[115678]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" returned: 0 in 0.287s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:43 devstack sudo[115684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 Aug 25 07:09:43 devstack sudo[115684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-95c57c3d-e9fd-413f-b317-abbb1bfbed5f" released by "delete_volume" :: held 0.728s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:43 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Created reservations ['2be41660-c1cf-407f-96bc-8c451874a187', 'bc239613-9a60-4d5a-b895-5a88263444a4', 'a4569a53-6ea9-4046-a69b-0fe285d484af', 'fa1a1c17-8d6c-4d3f-a417-1396de1696ee'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:44 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:44 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:44 devstack sudo[115684]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245" returned: 0 in 0.320s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:44 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 is being set with open permissions: ugo+rw Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:44 devstack sudo[115691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 Aug 25 07:09:44 devstack sudo[115691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:44 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.273s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:44 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7a652083-9a17-4ea3-82de-8c699bb93fd7 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-95c57c3d-e9fd-413f-b317-abbb1bfbed5f-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:44 devstack sudo[115691]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245" returned: 0 in 0.265s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:44 devstack sudo[115695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info Aug 25 07:09:44 devstack sudo[115695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:44 devstack sudo[115695]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:44 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info is being set with open permissions: ugo+rw Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:44 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info Aug 25 07:09:44 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (2665749d-7ea4-48d8-8488-0f8dc33866df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec461b05-f782-4046-8938-9529f000f75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec461b05-f782-4046-8938-9529f000f75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536154006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0ee78-4beb-47d6-9b3d-91433e2f5bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:45Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb059611-340d-4823-81ba-0f36980594e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb059611-340d-4823-81ba-0f36980594e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a5cb7b-1304-40e6-af63-145c64214201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a5cb7b-1304-40e6-af63-145c64214201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea0ee78-4beb-47d6-9b3d-91433e2f5bae', 'volume_name': 'volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76781665-237b-4b3f-956a-10bdce1830ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76781665-237b-4b3f-956a-10bdce1830ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffb40e2-5349-4ccb-84d9-2101f67b41f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:44 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Volume eea0ee78-4beb-47d6-9b3d-91433e2f5bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae', 'volume_size': 1} Aug 25 07:09:44 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:45 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.info" returned: 0 in 0.260s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536154006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0ee78-4beb-47d6-9b3d-91433e2f5bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:45Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Creating volume eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:45 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:45 devstack sudo[115701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae 1073741824 Aug 25 07:09:45 devstack sudo[115701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-dfbc8d22-74d0-4c11-9556-ea0461f91315 tempest-ProjectReaderTests-139380445 None] Create snapshot completed successfully Aug 25 07:09:45 devstack sudo[115701]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae 1073741824" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:45 devstack sudo[115706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae Aug 25 07:09:45 devstack sudo[115706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:45 devstack sudo[115706]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" returned: 0 in 0.253s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffb40e2-5349-4ccb-84d9-2101f67b41f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c84677-1a53-4cc8-b896-e13158ee264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Volume volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae (eea0ee78-4beb-47d6-9b3d-91433e2f5bae): created successfully Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c84677-1a53-4cc8-b896-e13158ee264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (2665749d-7ea4-48d8-8488-0f8dc33866df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:45 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-e9704af1-3695-4fbd-8e69-33f5fe7fc57e tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-33e4ab43-16cd-4e04-9e68-722aaa566245-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-33e4ab43-16cd-4e04-9e68-722aaa566245-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-33e4ab43-16cd-4e04-9e68-722aaa566245" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33e4ab43-16cd-4e04-9e68-722aaa566245" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Deleting offline snapshot 33e4ab43-16cd-4e04-9e68-722aaa566245 of volume 9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] snapshot_file for this snap is: volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c686e4e-ece7-4651-a42d-3775403ab2af]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:46 devstack sudo[115710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 Aug 25 07:09:46 devstack sudo[115710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:46 devstack sudo[115710]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245" returned: 0 in 0.361s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[00550df6-519a-4f74-ba25-f6454a22c4a8]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:46 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:46 devstack sudo[115715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 Aug 25 07:09:46 devstack sudo[115715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot eadbdba5-a4d6-43af-b83a-7cda443500ec of volume eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a9c6a5-15ac-40a3-b0c1-514e8d8bc0c0]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:47 devstack sudo[115715]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" returned: 0 in 0.381s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:47 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 Aug 25 07:09:47 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack sudo[115720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae Aug 25 07:09:47 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" returned: 0 in 0.409s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:47 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245" returned: 0 in 0.397s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:47 devstack sudo[115732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec 1G Aug 25 07:09:47 devstack sudo[115732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack sudo[115734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245 Aug 25 07:09:47 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33.33e4ab43-16cd-4e04-9e68-722aaa566245" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-33e4ab43-16cd-4e04-9e68-722aaa566245" released by "_delete_snapshot" :: held 1.522s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" released by "delete_snapshot" :: held 1.544s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=186,cinder:UPDATE=272,cinder:DELETE=19,cinder:INSERT=65 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG dbcounter [-] [94487] Writing DB stats cinder:SELECT=207,cinder:UPDATE=244,cinder:INSERT=71,cinder:DELETE=26 {{(pid=94487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Created reservations ['33799f68-e2d5-4763-aa75-29713a9ddced', '21c9d8e7-fd0e-4051-8f30-4b76e61a6fd4', 'c089fdbc-fd01-4180-a5a4-d38bd465d85f', '98eeb61e-ceb4-4b0a-8851-f1f5e398df57'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:47 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Delete snapshot completed successfully. Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c3c2e9ae-5808-4407-bf3c-3fbc77c60e72 tempest-ProjectReaderTests-139380445 None] Lock "cinder-33e4ab43-16cd-4e04-9e68-722aaa566245-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:47 devstack sudo[115732]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec 1G" returned: 0 in 0.503s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[115741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec Aug 25 07:09:48 devstack sudo[115741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack sudo[115741]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec is being set with open permissions: ugo+rw Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[115746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec Aug 25 07:09:48 devstack sudo[115746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-9e9d83e1-bf55-4795-9dd2-81a70abd7c33-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-9e9d83e1-bf55-4795-9dd2-81a70abd7c33-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:48 devstack sudo[115746]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596f566-f128-48b7-95ae-f36f4ca16f64]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec" returned: 0 in 0.262s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[115751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info Aug 25 07:09:48 devstack sudo[115751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack sudo[115750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 Aug 25 07:09:48 devstack sudo[115750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack sudo[115751]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info" returned: 0 in 0.294s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info is being set with open permissions: ugo+rw Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[115757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info Aug 25 07:09:48 devstack sudo[115757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack sudo[115750]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" returned: 0 in 0.411s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[115760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33 Aug 25 07:09:48 devstack sudo[115760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:49 devstack sudo[115757]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.info" returned: 0 in 0.272s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-fe5e204f-b76f-416f-af67-9f31c4fbf3f1 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:49 devstack sudo[115760]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-quobyte-9e9d83e1-bf55-4795-9dd2-81a70abd7c33" released by "delete_volume" :: held 0.740s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Created reservations ['752e2f25-7522-4bbd-8d81-0de187ad9b83', '112f1842-42c2-41bb-9efe-b724e888b128', 'a4bfa35b-0ed7-4471-b5dc-bd393fe108cc', 'e8edebdb-16f8-41a0-a196-e855675d1e08'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:49 devstack sudo[115764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:49 devstack sudo[115764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:49 devstack sudo[115764]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:49 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Deleted volume successfully. Aug 25 07:09:49 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-b3326e2c-f824-4ffc-9b5e-0076985ca6c3 tempest-ProjectReaderTests-139380445 None] Lock "cinder-9e9d83e1-bf55-4795-9dd2-81a70abd7c33-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-eadbdba5-a4d6-43af-b83a-7cda443500ec-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-eadbdba5-a4d6-43af-b83a-7cda443500ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-eadbdba5-a4d6-43af-b83a-7cda443500ec" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eadbdba5-a4d6-43af-b83a-7cda443500ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot eadbdba5-a4d6-43af-b83a-7cda443500ec of volume eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8239011-f4e5-4dd4-930c-464d72c3bc2e]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:50 devstack sudo[115767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec Aug 25 07:09:50 devstack sudo[115767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:50 devstack sudo[115767]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec" returned: 0 in 0.393s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640afbf-617e-46d6-ab99-0397b9ee4a9f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:50 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:50 devstack sudo[115772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae Aug 25 07:09:50 devstack sudo[115772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack sudo[115772]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" returned: 0 in 0.411s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:51 devstack sudo[115777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec Aug 25 07:09:51 devstack sudo[115777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack sudo[115777]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec" returned: 0 in 0.355s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:51 devstack sudo[115782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec Aug 25 07:09:51 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae.eadbdba5-a4d6-43af-b83a-7cda443500ec" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eadbdba5-a4d6-43af-b83a-7cda443500ec" released by "_delete_snapshot" :: held 1.509s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" released by "delete_snapshot" :: held 1.536s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Created reservations ['9551a89e-20ea-40d1-b55d-93dc074487d7', '87b361c2-eb0e-4e09-bcb8-97b367a1d0b6', 'b1ff9df8-2422-453e-a461-9ed029ef286e', '8d628a7e-fc78-4495-b3a0-29af6aa91876'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:51 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:09:51 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-9d9adb35-5de0-40f9-ab9e-0d17231dd81e tempest-ProjectMemberTests-1254747993 None] Lock "cinder-eadbdba5-a4d6-43af-b83a-7cda443500ec-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-eea0ee78-4beb-47d6-9b3d-91433e2f5bae-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-eea0ee78-4beb-47d6-9b3d-91433e2f5bae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2ebbb-8b3a-458b-a3a1-c9193b467594]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae Aug 25 07:09:52 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:52 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" returned: 0 in 0.378s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[115790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae Aug 25 07:09:52 devstack sudo[115790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:53 devstack sudo[115790]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-eea0ee78-4beb-47d6-9b3d-91433e2f5bae" released by "delete_volume" :: held 0.706s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Created reservations ['bba89a03-6272-4dad-83d4-ad8c24dfc545', '205dc87d-a329-4de3-b520-aec5fdaa3f02', '725255ff-adc6-4114-aa7b-4f9629323608', '5a6d9a12-8416-4630-8666-0587636c9173'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:53 devstack sudo[115793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:09:53 devstack sudo[115793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:53 devstack sudo[115793]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.281s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:53 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:09:53 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-096e4583-3cca-4e73-90ed-f8a0901a70c4 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-eea0ee78-4beb-47d6-9b3d-91433e2f5bae-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (c1afacc7-e0df-46b2-8fbc-f8a9ed7eb9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f78c0c4-9f37-459a-8481-bfb8ef668608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f78c0c4-9f37-459a-8481-bfb8ef668608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584718218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d690a0b-3c40-4c27-9f08-1bd718b07c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:54Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e60538-d31d-453f-bfb8-15b75873f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e60538-d31d-453f-bfb8-15b75873f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a67e43-d5a0-453f-9725-756b222594b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a67e43-d5a0-453f-9725-756b222594b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d690a0b-3c40-4c27-9f08-1bd718b07c62', 'volume_name': 'volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586bb41d-c104-4287-85da-919dddccfedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586bb41d-c104-4287-85da-919dddccfedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73c440-150a-48f8-bb56-c24efc2a2892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Volume 2d690a0b-3c40-4c27-9f08-1bd718b07c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62', 'volume_size': 1} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584718218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d690a0b-3c40-4c27-9f08-1bd718b07c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:54Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Creating volume 2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:54 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:54 devstack sudo[115796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 1073741824 Aug 25 07:09:54 devstack sudo[115796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:54 devstack sudo[115796]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 1073741824" returned: 0 in 0.428s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:54 devstack sudo[115802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 Aug 25 07:09:54 devstack sudo[115802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:54 devstack sudo[115802]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62" returned: 0 in 0.269s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73c440-150a-48f8-bb56-c24efc2a2892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c087a-5ec7-4943-b2d9-41f35626b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Volume volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 (2d690a0b-3c40-4c27-9f08-1bd718b07c62): created successfully Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c087a-5ec7-4943-b2d9-41f35626b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (c1afacc7-e0df-46b2-8fbc-f8a9ed7eb9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:54 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-557cb1b8-9a90-4056-8437-b05a88d554c2 tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 1f9d7175-1969-445a-9b7f-51dda8de832a of volume 2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[841544d8-cd0c-4c40-b52c-ea2f512ff3c7]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:55 devstack sudo[115805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 Aug 25 07:09:55 devstack sudo[115805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:55 devstack sudo[115805]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62" returned: 0 in 0.400s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:55 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:55 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a 1G Aug 25 07:09:55 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a 1G" returned: 0 in 0.416s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[115816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a Aug 25 07:09:56 devstack sudo[115816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack sudo[115816]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a is being set with open permissions: ugo+rw Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[115821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a Aug 25 07:09:56 devstack sudo[115821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack sudo[115821]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a" returned: 0 in 0.252s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[115824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info Aug 25 07:09:56 devstack sudo[115824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack sudo[115824]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info" returned: 0 in 0.302s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info is being set with open permissions: ugo+rw Aug 25 07:09:56 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[115827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info Aug 25 07:09:56 devstack sudo[115827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:57 devstack sudo[115827]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.info" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:57 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:57 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-5e22db88-232a-4376-ad83-e7c85900f8d4 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-1f9d7175-1969-445a-9b7f-51dda8de832a-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-1f9d7175-1969-445a-9b7f-51dda8de832a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-1f9d7175-1969-445a-9b7f-51dda8de832a" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-1f9d7175-1969-445a-9b7f-51dda8de832a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 1f9d7175-1969-445a-9b7f-51dda8de832a of volume 2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef798cb-9ee3-4016-a4e9-182f6369644f]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:58 devstack sudo[115864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a Aug 25 07:09:58 devstack sudo[115864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:58 devstack sudo[115864]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a" returned: 0 in 0.423s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7366304a-07be-4acb-8625-8ed9925da9ce]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:58 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:59 devstack sudo[115873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 Aug 25 07:09:59 devstack sudo[115873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:59 devstack sudo[115873]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62" returned: 0 in 0.421s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:59 devstack sudo[115878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a Aug 25 07:09:59 devstack sudo[115878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:59 devstack sudo[115878]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a" returned: 0 in 0.391s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:59 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:59 devstack sudo[115890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a Aug 25 07:09:59 devstack sudo[115890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:00 devstack sudo[115890]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62.1f9d7175-1969-445a-9b7f-51dda8de832a" returned: 0 in 0.295s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-1f9d7175-1969-445a-9b7f-51dda8de832a" released by "_delete_snapshot" :: held 1.653s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" released by "delete_snapshot" :: held 1.682s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Created reservations ['ca97ebb1-825e-4bf6-b969-11cf53394c37', '81b87947-55b0-4084-aeb3-5f925a0859ac', 'fe2c3fed-1dfb-41b8-affa-bfa656fdd60e', 'cae28b15-75aa-4514-bb3d-01b1071b228a'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:00 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-4794a65d-fca4-4c2b-95e4-d29487ecdde0 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-1f9d7175-1969-445a-9b7f-51dda8de832a-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-2d690a0b-3c40-4c27-9f08-1bd718b07c62-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "cinder-2d690a0b-3c40-4c27-9f08-1bd718b07c62-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" acquired by "delete_volume" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba4297-3392-49ae-8f2e-ebfa70b7a4ea]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:00 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:00 devstack sudo[115893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 Aug 25 07:10:00 devstack sudo[115893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:00 devstack sudo[115894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:00 devstack sudo[115894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack sudo[115894]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.297s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_service.periodic_task [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] Running periodic task VolumeManager._thread_info {{(pid=94487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread count: 28 {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5569}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-6f159b46-1a35-4099-ae96-05387cbfa190 None None] thread info: [<_MainThread(MainThread, started 135685274955904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5570}} Aug 25 07:10:01 devstack sudo[115893]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62" returned: 0 in 0.408s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack sudo[115905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62 Aug 25 07:10:01 devstack sudo[115905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack sudo[115905]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-2d690a0b-3c40-4c27-9f08-1bd718b07c62" returned: 0 in 0.282s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-2d690a0b-3c40-4c27-9f08-1bd718b07c62" released by "delete_volume" :: held 0.764s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Created reservations ['5ddef432-a343-4f8e-a4b1-92b80c6bec63', 'ac512622-6cba-4176-95a8-3bbf56ba5d0c', '61910cb5-5409-41f6-a5e9-9025a6fe0b44', 'f9f98e45-81e4-4b28-a3b9-17d2caf45d6c'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack sudo[115908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:01 devstack sudo[115908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack sudo[115908]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.288s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:01 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:10:01 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-447eb909-a402-43c1-86c7-c1d5237ada8c tempest-ProjectMemberTests-1254747993 None] Lock "cinder-2d690a0b-3c40-4c27-9f08-1bd718b07c62-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (da44a558-64e2-4904-a80c-7d2cbab83ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b636351-626e-461b-a584-7ff71637e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b636351-626e-461b-a584-7ff71637e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378299666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533f8291-24e2-4ca5-9f81-0091de1be2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:02Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ceacda-42ff-499d-8ca6-26863c4d68dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ceacda-42ff-499d-8ca6-26863c4d68dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c956febd-ab10-4464-9f1e-d4da837734ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c956febd-ab10-4464-9f1e-d4da837734ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533f8291-24e2-4ca5-9f81-0091de1be2f5', 'volume_name': 'volume-533f8291-24e2-4ca5-9f81-0091de1be2f5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1322e36a-cf39-4574-80a4-c5ea93992631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1322e36a-cf39-4574-80a4-c5ea93992631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd7cdea-167a-4a54-a0c6-08926a3761e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:02 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Volume 533f8291-24e2-4ca5-9f81-0091de1be2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533f8291-24e2-4ca5-9f81-0091de1be2f5', 'volume_size': 1} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378299666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533f8291-24e2-4ca5-9f81-0091de1be2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c56964e254597ac25e98a11f64fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:02Z,use_quota=True,user_id='71b770a2214b498ea2371e720eff1705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Creating volume 533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:02 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[115911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 1073741824 Aug 25 07:10:02 devstack sudo[115911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack sudo[115911]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:02 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 1073741824" returned: 0 in 0.477s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack sudo[115917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 Aug 25 07:10:03 devstack sudo[115917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack sudo[115917]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5" returned: 0 in 0.259s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd7cdea-167a-4a54-a0c6-08926a3761e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533f8291-24e2-4ca5-9f81-0091de1be2f5', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e84750-1fd2-4199-8acb-a551f2335740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:03 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Volume volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 (533f8291-24e2-4ca5-9f81-0091de1be2f5): created successfully Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e84750-1fd2-4199-8acb-a551f2335740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:03 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Flow 'volume_create_manager' (da44a558-64e2-4904-a80c-7d2cbab83ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:03 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-aaadc764-9353-4286-9850-fc5afa05e68a tempest-ProjectMemberTests-1254747993 None] Created volume successfully. Aug 25 07:10:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:04 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Creating offline snapshot 4f3bc64e-8f12-419f-999c-4ef2234be017 of volume 533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:04 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe5a4c-9020-4eaa-a663-0e653d993355]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:04 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack sudo[115920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 Aug 25 07:10:04 devstack sudo[115920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack sudo[115920]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5" returned: 0 in 0.422s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 1G {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack sudo[115925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 1G Aug 25 07:10:05 devstack sudo[115925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack sudo[115925]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 1G" returned: 0 in 0.390s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack sudo[115930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 Aug 25 07:10:05 devstack sudo[115930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack sudo[115930]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 -F qcow2 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017" returned: 0 in 0.305s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 is being set with open permissions: ugo+rw Aug 25 07:10:05 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack sudo[115935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 Aug 25 07:10:05 devstack sudo[115935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[115935]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017" returned: 0 in 0.267s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack sudo[115938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info Aug 25 07:10:06 devstack sudo[115938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[115938]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info" returned: 0 in 0.268s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94487]: WARNING cinder.volume.drivers.remotefs [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info is being set with open permissions: ugo+rw Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack sudo[115941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info Aug 25 07:10:06 devstack sudo[115941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[115941]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.info" returned: 0 in 0.267s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:06 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-11a9b040-8593-488a-b8c3-a0a525e214a0 tempest-ProjectMemberTests-1254747993 None] Create snapshot completed successfully Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-4f3bc64e-8f12-419f-999c-4ef2234be017-delete_snapshot" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-4f3bc64e-8f12-419f-999c-4ef2234be017-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" by "delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-4f3bc64e-8f12-419f-999c-4ef2234be017" by "_delete_snapshot" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:07 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-4f3bc64e-8f12-419f-999c-4ef2234be017" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Deleting offline snapshot 4f3bc64e-8f12-419f-999c-4ef2234be017 of volume 533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] snapshot_file for this snap is: volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c986ea-e206-47b5-99dc-875bbaa490fc]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:08 devstack sudo[115944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 Aug 25 07:10:08 devstack sudo[115944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:08 devstack sudo[115944]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017" returned: 0 in 0.390s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533f8291-24e2-4ca5-9f81-0091de1be2f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563cf11-f1e6-4cdb-889d-4178078d3e85]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:08 devstack sudo[115949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 Aug 25 07:10:08 devstack sudo[115949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:08 devstack sudo[115949]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5" returned: 0 in 0.366s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:08 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:08 devstack sudo[115955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 Aug 25 07:10:08 devstack sudo[115955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:09 devstack sudo[115955]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017" returned: 0 in 0.329s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:09 devstack sudo[115960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017 Aug 25 07:10:09 devstack sudo[115960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:09 devstack sudo[115960]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5.4f3bc64e-8f12-419f-999c-4ef2234be017" returned: 0 in 0.245s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-4f3bc64e-8f12-419f-999c-4ef2234be017" released by "_delete_snapshot" :: held 1.420s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" released by "delete_snapshot" :: held 1.446s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Created reservations ['e6c43d35-d0ad-48dc-b902-97831198ab02', '8fdde7b5-5cdf-46d6-9996-6271b9970775', '4706e0d8-e831-476c-9877-1b6bc7839b89', 'e9119cb8-f253-45b0-8348-5b64c9d54eb4'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:09 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Delete snapshot completed successfully. Aug 25 07:10:09 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-98ff8a83-49a2-4718-841d-0a36183c3e25 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-4f3bc64e-8f12-419f-999c-4ef2234be017-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-533f8291-24e2-4ca5-9f81-0091de1be2f5-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-533f8291-24e2-4ca5-9f81-0091de1be2f5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd4d87-397b-40ac-a279-96832d033471]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:10 devstack sudo[115963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 Aug 25 07:10:10 devstack sudo[115963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:10 devstack sudo[115963]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5" returned: 0 in 0.344s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:10 devstack sudo[115968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5 Aug 25 07:10:10 devstack sudo[115968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:10 devstack sudo[115968]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-533f8291-24e2-4ca5-9f81-0091de1be2f5" returned: 0 in 0.243s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-quobyte-533f8291-24e2-4ca5-9f81-0091de1be2f5" released by "delete_volume" :: held 0.640s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Created reservations ['8ee854df-24b5-4eab-95e3-115776930cc1', '37627270-9f7d-42c7-9732-ae10e8cc8e4c', '0d67a190-37a3-4183-a921-5a767604b9f4', '70907c4e-6612-443f-a07e-04654529f675'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:10 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:10 devstack sudo[115971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:10 devstack sudo[115971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:11 devstack sudo[115971]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:11 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.248s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:11 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:11 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Deleted volume successfully. Aug 25 07:10:11 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-d52217b3-b24b-40ae-8a43-cfda44cbdc24 tempest-ProjectMemberTests-1254747993 None] Lock "cinder-533f8291-24e2-4ca5-9f81-0091de1be2f5-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (c8aa4450-8ad3-477d-a819-af7b15aa9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a24ec6a-8125-45f5-9813-e44b7358bb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a24ec6a-8125-45f5-9813-e44b7358bb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380722593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c9e2e0-3fda-409e-917d-8f24b455b2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:15Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a17e82-e802-4984-a0ee-4ddf305b56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a17e82-e802-4984-a0ee-4ddf305b56df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e97bdae-de9a-4e55-ade4-959fbb7a5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e97bdae-de9a-4e55-ade4-959fbb7a5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c9e2e0-3fda-409e-917d-8f24b455b2be', 'volume_name': 'volume-04c9e2e0-3fda-409e-917d-8f24b455b2be', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f08b97-f937-44aa-b226-bd5c76a5c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f08b97-f937-44aa-b226-bd5c76a5c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289fd509-5234-4689-99d5-77f413d17b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Volume 04c9e2e0-3fda-409e-917d-8f24b455b2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c9e2e0-3fda-409e-917d-8f24b455b2be', 'volume_size': 1} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380722593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c9e2e0-3fda-409e-917d-8f24b455b2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:15Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Creating volume 04c9e2e0-3fda-409e-917d-8f24b455b2be {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:14 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:10:14 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:14 devstack sudo[115974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be 1073741824 Aug 25 07:10:14 devstack sudo[115974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:15 devstack sudo[115974]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be 1073741824" returned: 0 in 0.410s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:15 devstack sudo[115979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be Aug 25 07:10:15 devstack sudo[115979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:15 devstack sudo[115979]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be" returned: 0 in 0.242s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289fd509-5234-4689-99d5-77f413d17b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c9e2e0-3fda-409e-917d-8f24b455b2be', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01a39c-5d0a-4ae1-8b01-485ede271ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:15 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Volume volume-04c9e2e0-3fda-409e-917d-8f24b455b2be (04c9e2e0-3fda-409e-917d-8f24b455b2be): created successfully Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01a39c-5d0a-4ae1-8b01-485ede271ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (c8aa4450-8ad3-477d-a819-af7b15aa9673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:15 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-b9ada1f8-03c9-407f-85ea-e22ddb0c6b72 tempest-ProjectReaderTests-130237215 None] Created volume successfully. Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-04c9e2e0-3fda-409e-917d-8f24b455b2be-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:15 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "cinder-04c9e2e0-3fda-409e-917d-8f24b455b2be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-quobyte-04c9e2e0-3fda-409e-917d-8f24b455b2be" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-04c9e2e0-3fda-409e-917d-8f24b455b2be" acquired by "delete_volume" :: waited 0.015s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[25911b57-190a-435c-ac50-2093e9a5de10]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:16 devstack sudo[115982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be Aug 25 07:10:16 devstack sudo[115982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:16 devstack sudo[115982]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be" returned: 0 in 0.351s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:16 devstack sudo[115987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be Aug 25 07:10:16 devstack sudo[115987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:16 devstack sudo[115987]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-04c9e2e0-3fda-409e-917d-8f24b455b2be" returned: 0 in 0.243s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-04c9e2e0-3fda-409e-917d-8f24b455b2be" released by "delete_volume" :: held 0.633s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Created reservations ['b1784d39-c5fb-48da-84f2-59af59396df2', 'a0c740e7-16d4-48d6-af28-b8ec8afffe06', '97f127f6-88ca-425e-8f17-718e9e17996d', '2c3c464e-e211-4e2e-a57a-ab9efe55a169'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:16 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:16 devstack sudo[115990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:16 devstack sudo[115990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:17 devstack sudo[115990]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.236s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:17 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Deleted volume successfully. Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-c57acdd2-e1dd-4278-93ac-9336fb1476bc tempest-ProjectReaderTests-130237215 None] Lock "cinder-04c9e2e0-3fda-409e-917d-8f24b455b2be-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (65b79248-218f-4f5e-bae7-cf13d3788aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9111ee61-43a6-4e7a-b5c1-55f96658cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9111ee61-43a6-4e7a-b5c1-55f96658cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447393346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fff9d52-7c4a-405f-a7ee-c2fe2750c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfc3add-85f6-4b66-9078-25645b11b804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfc3add-85f6-4b66-9078-25645b11b804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8046201-fac1-4e41-8153-4b7205b0e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8046201-fac1-4e41-8153-4b7205b0e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fff9d52-7c4a-405f-a7ee-c2fe2750c15f', 'volume_name': 'volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb72c264-e54d-467d-865a-de48d4cd81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb72c264-e54d-467d-865a-de48d4cd81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b827a4-2ae8-4496-ac0e-a29321495d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Volume 3fff9d52-7c4a-405f-a7ee-c2fe2750c15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f', 'volume_size': 1} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447393346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fff9d52-7c4a-405f-a7ee-c2fe2750c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Creating volume 3fff9d52-7c4a-405f-a7ee-c2fe2750c15f {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:17 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:10:17 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:17 devstack sudo[115993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f 1073741824 Aug 25 07:10:17 devstack sudo[115993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:18 devstack sudo[115993]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f 1073741824" returned: 0 in 0.405s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:18 devstack sudo[115999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f Aug 25 07:10:18 devstack sudo[115999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:18 devstack sudo[115999]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" returned: 0 in 0.238s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b827a4-2ae8-4496-ac0e-a29321495d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7301cf-a195-45c1-9ebb-6d5aa1853622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Volume volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f (3fff9d52-7c4a-405f-a7ee-c2fe2750c15f): created successfully Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7301cf-a195-45c1-9ebb-6d5aa1853622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (65b79248-218f-4f5e-bae7-cf13d3788aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:18 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-27c29e73-9945-418b-8a1b-a917099e59cc tempest-ProjectReaderTests-130237215 None] Created volume successfully. Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "cinder-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-quobyte-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7747b80-8fea-4179-822a-7da5567f2c76]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:18 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:18 devstack sudo[116003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f Aug 25 07:10:18 devstack sudo[116003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack sudo[116003]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" returned: 0 in 0.367s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[116008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f Aug 25 07:10:19 devstack sudo[116008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack sudo[116008]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" returned: 0 in 0.243s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f" released by "delete_volume" :: held 0.649s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Created reservations ['ce904888-c9eb-4bcc-b093-6d2559a1d3cf', '993abd05-a79f-4a1a-991e-466131baaacb', 'a71c9873-9664-4a82-8ba8-c759ca0f8f7a', '6a62cb93-54ca-4ba2-b512-bc4889e77fc3'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[116011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:19 devstack sudo[116011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack sudo[116011]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.236s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:19 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Deleted volume successfully. Aug 25 07:10:19 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-8e6b6a04-88d2-4707-9fb5-9d2d0da3e123 tempest-ProjectReaderTests-130237215 None] Lock "cinder-3fff9d52-7c4a-405f-a7ee-c2fe2750c15f-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (1b895b64-1d83-46d5-9890-0f65366428e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6ec71a-290c-43c0-a4c4-fb1232e21a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6ec71a-290c-43c0-a4c4-fb1232e21a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669669091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42c02cf-2085-4035-94ae-ddcad3a2ce52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:20Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4429a8-a164-4955-ba68-f58291365a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4429a8-a164-4955-ba68-f58291365a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c6bc07-9e89-4e3b-9cfa-63dd807bc7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c6bc07-9e89-4e3b-9cfa-63dd807bc7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42c02cf-2085-4035-94ae-ddcad3a2ce52', 'volume_name': 'volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7e3382-6164-4619-803a-b78c6dd06421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7e3382-6164-4619-803a-b78c6dd06421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5465c715-86d1-4ee1-808c-b0e4d99c41a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:20 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Volume f42c02cf-2085-4035-94ae-ddcad3a2ce52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52', 'volume_size': 1} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669669091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42c02cf-2085-4035-94ae-ddcad3a2ce52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:20Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Creating volume f42c02cf-2085-4035-94ae-ddcad3a2ce52 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:20 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack sudo[116014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 1073741824 Aug 25 07:10:20 devstack sudo[116014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack sudo[116014]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 1073741824" returned: 0 in 0.400s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack sudo[116020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 Aug 25 07:10:20 devstack sudo[116020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack sudo[116020]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52" returned: 0 in 0.248s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5465c715-86d1-4ee1-808c-b0e4d99c41a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e7ad8b-d4c1-4d84-9568-9c5f81349b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:21 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Volume volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 (f42c02cf-2085-4035-94ae-ddcad3a2ce52): created successfully Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e7ad8b-d4c1-4d84-9568-9c5f81349b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (1b895b64-1d83-46d5-9890-0f65366428e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:21 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-4ceda9c0-d069-468b-943b-6237b4fb3058 tempest-ProjectReaderTests-130237215 None] Created volume successfully. Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-f42c02cf-2085-4035-94ae-ddcad3a2ce52-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "cinder-f42c02cf-2085-4035-94ae-ddcad3a2ce52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-quobyte-f42c02cf-2085-4035-94ae-ddcad3a2ce52" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-f42c02cf-2085-4035-94ae-ddcad3a2ce52" acquired by "delete_volume" :: waited 0.014s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac52285-0639-43b6-8ed9-c700e1b006f1]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack sudo[116023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 Aug 25 07:10:21 devstack sudo[116023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack sudo[116023]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52" returned: 0 in 0.346s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack sudo[116028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52 Aug 25 07:10:21 devstack sudo[116028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack sudo[116028]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-f42c02cf-2085-4035-94ae-ddcad3a2ce52" returned: 0 in 0.247s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-f42c02cf-2085-4035-94ae-ddcad3a2ce52" released by "delete_volume" :: held 0.636s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Created reservations ['59ffa3bf-7949-4b2a-87d6-c0461f5d5557', '6ae1bd4e-7422-4071-ab3d-71f399ba807e', 'f80e6f73-b477-4f28-aa35-aaf5e9052a04', '7061df3f-c083-4a51-8c36-5b7243eda81d'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:22 devstack sudo[116031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:22 devstack sudo[116031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack sudo[116031]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.237s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:22 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Deleted volume successfully. Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-7b0cd1ad-0c8c-4fb7-ab41-5d059d9d07d2 tempest-ProjectReaderTests-130237215 None] Lock "cinder-f42c02cf-2085-4035-94ae-ddcad3a2ce52-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (11575250-3a08-4e8d-ad14-61462435ac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91309f22-41fd-4716-acf9-47b5922c1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91309f22-41fd-4716-acf9-47b5922c1392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572222992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f956a53-f045-4a2b-b277-9228ffbd8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:23Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7ca28e-b82e-4279-b0f1-fef8af6500f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7ca28e-b82e-4279-b0f1-fef8af6500f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:22 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a249e3d1-1bfc-40e4-b637-f79e5997927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a249e3d1-1bfc-40e4-b637-f79e5997927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f956a53-f045-4a2b-b277-9228ffbd8926', 'volume_name': 'volume-6f956a53-f045-4a2b-b277-9228ffbd8926', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a0b185-bcbd-4975-aeda-a64d2ebc215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a0b185-bcbd-4975-aeda-a64d2ebc215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48bb6d8-d868-4065-a1cd-0b1c7c53ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Volume 6f956a53-f045-4a2b-b277-9228ffbd8926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f956a53-f045-4a2b-b277-9228ffbd8926', 'volume_size': 1} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572222992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f956a53-f045-4a2b-b277-9228ffbd8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e751c867da4e51910183185374b800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:23Z,use_quota=True,user_id='ea66d8ffe86346d7bf9be0dbb066b7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801f396e-7213-4c41-bfb3-49e235af250a),volume_type_id=801f396e-7213-4c41-bfb3-49e235af250a)}" {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.remotefs [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Creating volume 6f956a53-f045-4a2b-b277-9228ffbd8926 {{(pid=94487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Selected osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 as target Quobyte volume. {{(pid=94487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:23 devstack cinder-volume[94487]: INFO cinder.volume.drivers.remotefs [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] casted to osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07 Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 1073741824 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack sudo[116034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 1073741824 Aug 25 07:10:23 devstack sudo[116034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack sudo[116034]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 1073741824" returned: 0 in 0.389s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack sudo[116039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 Aug 25 07:10:23 devstack sudo[116039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack sudo[116039]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926" returned: 0 in 0.255s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'} {{(pid=94487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48bb6d8-d868-4065-a1cd-0b1c7c53ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f956a53-f045-4a2b-b277-9228ffbd8926', 'volume_size': 1}' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492ed65-bf87-4fb7-9fb6-8a860ede002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:23 devstack cinder-volume[94487]: INFO cinder.volume.flows.manager.create_volume [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Volume volume-6f956a53-f045-4a2b-b277-9228ffbd8926 (6f956a53-f045-4a2b-b277-9228ffbd8926): created successfully Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492ed65-bf87-4fb7-9fb6-8a860ede002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Flow 'volume_create_manager' (11575250-3a08-4e8d-ad14-61462435ac57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:23 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-a9007623-43ef-4119-a036-e26deedde6ad tempest-ProjectReaderTests-130237215 None] Created volume successfully. Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-6f956a53-f045-4a2b-b277-9228ffbd8926-delete_volume" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:23 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "cinder-6f956a53-f045-4a2b-b277-9228ffbd8926-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Acquiring lock "cinder-quobyte-6f956a53-f045-4a2b-b277-9228ffbd8926" by "delete_volume" {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-6f956a53-f045-4a2b-b277-9228ffbd8926" acquired by "delete_volume" :: waited 0.013s {{(pid=94487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0140005a-709a-47d2-8d99-96775126bab2]: (4, 'qcow2') {{(pid=96167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[116042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 Aug 25 07:10:24 devstack sudo[116042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack sudo[116042]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926" returned: 0 in 0.352s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[116047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926 Aug 25 07:10:24 devstack sudo[116047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack sudo[116047]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3/volume-6f956a53-f045-4a2b-b277-9228ffbd8926" returned: 0 in 0.264s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "cinder-quobyte-6f956a53-f045-4a2b-b277-9228ffbd8926" released by "delete_volume" :: held 0.654s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.quota [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Created reservations ['d937527b-3bc6-429c-9fa7-0cdfe8b4bfb1', '2fa14f15-4981-4494-b508-13bf8b8b28ac', 'cab76e1b-ac28-4c9b-b1fe-1357d451703a', '8722f2d4-c78b-4de5-8814-e80abb55fb4b'] {{(pid=94487) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07': None} {{(pid=94487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG cinder.volume.drivers.quobyte [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c0ae50d-1049-4133-bf9d-f2501f7d2b07'] {{(pid=94487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.lockutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:24 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[116050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3 Aug 25 07:10:24 devstack sudo[116050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack sudo[116050]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:25 devstack cinder-volume[94487]: DEBUG oslo_concurrency.processutils [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2def32267348c07358c641749d870e3" returned: 0 in 0.239s {{(pid=94487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:25 devstack cinder-volume[94487]: DEBUG cinder.manager [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Notifying Schedulers of capabilities ... {{(pid=94487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:25 devstack cinder-volume[94487]: INFO cinder.volume.manager [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Deleted volume successfully. Aug 25 07:10:25 devstack cinder-volume[94487]: DEBUG cinder.coordination [None req-976dfc41-aa47-4f49-a78d-315b011facdc tempest-ProjectReaderTests-130237215 None] Lock "cinder-6f956a53-f045-4a2b-b277-9228ffbd8926-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=94487) __release /opt/stack/cinder/cinder/coordination.py:152}}